-- Logs begin at Thu 2022-05-26 11:41:45 UTC, end at Thu 2022-05-26 13:06:39 UTC. -- May 26 12:35:39.746800 dv-cinder-815712-9-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 26 12:35:39.756994 dv-cinder-815712-9-iscsi devstack@n-api.service[110283]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 26 12:35:39.760267 dv-cinder-815712-9-iscsi devstack@n-api.service[110283]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 26 12:35:39 2022] *** May 26 12:35:39.760267 dv-cinder-815712-9-iscsi devstack@n-api.service[110283]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 26 12:35:39.760267 dv-cinder-815712-9-iscsi devstack@n-api.service[110283]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 26 12:35:39.760267 dv-cinder-815712-9-iscsi devstack@n-api.service[110283]: nodename: dv-cinder-815712-9-iscsi May 26 12:35:39.760267 dv-cinder-815712-9-iscsi devstack@n-api.service[110283]: machine: x86_64 May 26 12:35:39.760267 dv-cinder-815712-9-iscsi devstack@n-api.service[110283]: clock source: unix May 26 12:35:39.760267 dv-cinder-815712-9-iscsi devstack@n-api.service[110283]: pcre jit disabled May 26 12:35:39.760267 dv-cinder-815712-9-iscsi devstack@n-api.service[110283]: detected number of CPU cores: 4 May 26 12:35:39.760267 dv-cinder-815712-9-iscsi devstack@n-api.service[110283]: current working directory: / May 26 12:35:39.760267 dv-cinder-815712-9-iscsi devstack@n-api.service[110283]: detected binary path: /usr/bin/uwsgi-core May 26 12:35:39.760267 dv-cinder-815712-9-iscsi devstack@n-api.service[110283]: your processes number limit is 47680 May 26 12:35:39.760267 dv-cinder-815712-9-iscsi devstack@n-api.service[110283]: your memory page size is 4096 bytes May 26 12:35:39.760267 dv-cinder-815712-9-iscsi devstack@n-api.service[110283]: detected max file descriptor number: 2048 May 26 12:35:39.760267 dv-cinder-815712-9-iscsi devstack@n-api.service[110283]: lock engine: pthread robust mutexes May 26 12:35:39.761206 dv-cinder-815712-9-iscsi devstack@n-api.service[110283]: thunder lock: enabled May 26 12:35:39.761206 dv-cinder-815712-9-iscsi devstack@n-api.service[110283]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 26 12:35:39.761206 dv-cinder-815712-9-iscsi devstack@n-api.service[110283]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 26 12:35:39.806736 dv-cinder-815712-9-iscsi devstack@n-api.service[110283]: Python main interpreter initialized at 0x55a1b47659c0 May 26 12:35:39.806736 dv-cinder-815712-9-iscsi devstack@n-api.service[110283]: python threads support enabled May 26 12:35:39.806736 dv-cinder-815712-9-iscsi devstack@n-api.service[110283]: your server socket listen backlog is limited to 100 connections May 26 12:35:39.806736 dv-cinder-815712-9-iscsi devstack@n-api.service[110283]: your mercy for graceful operations on workers is 90 seconds May 26 12:35:39.806736 dv-cinder-815712-9-iscsi devstack@n-api.service[110283]: mapped 403077 bytes (393 KB) for 2 cores May 26 12:35:39.806736 dv-cinder-815712-9-iscsi devstack@n-api.service[110283]: *** Operational MODE: preforking *** May 26 12:35:39.807296 dv-cinder-815712-9-iscsi devstack@n-api.service[110283]: *** uWSGI is running in multiple interpreter mode *** May 26 12:35:39.807296 dv-cinder-815712-9-iscsi devstack@n-api.service[110283]: spawned uWSGI master process (pid: 110283) May 26 12:35:39.807253 dv-cinder-815712-9-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 26 12:35:39.807800 dv-cinder-815712-9-iscsi devstack@n-api.service[110283]: spawned uWSGI worker 1 (pid: 110284, cores: 1) May 26 12:35:39.810300 dv-cinder-815712-9-iscsi devstack@n-api.service[110283]: spawned uWSGI worker 2 (pid: 110285, cores: 1) May 26 12:35:39.810300 dv-cinder-815712-9-iscsi devstack@n-api.service[110283]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 26 12:35:41.003589 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 26 12:35:41.039377 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 26 12:35:41.745722 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 12:35:41.745722 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: from cryptography.utils import int_from_bytes May 26 12:35:41.746079 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 12:35:41.746079 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: from cryptography.utils import int_from_bytes May 26 12:35:41.767622 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 12:35:41.767622 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: from cryptography.utils import int_from_bytes May 26 12:35:41.767963 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 12:35:41.767963 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: from cryptography.utils import int_from_bytes May 26 12:35:44.406723 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 12:35:44.407328 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 12:35:44.407507 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 12:35:44.407874 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 12:35:44.408122 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 12:35:44.408507 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.408838 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.409152 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.409469 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.409828 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.410141 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.410458 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.410777 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.411102 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.411361 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.412221 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.412538 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815712-9-iscsi {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.412859 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.413165 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.413478 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.413823 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.414123 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.414442 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.414745 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.415245 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.416544 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.416544 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.416544 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.417087 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.417087 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.417320 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.417515 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.417844 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.418209 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.418519 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.418919 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815712-9-iscsi {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.419242 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.419546 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.419859 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.420277 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.420586 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.420896 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.422105 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.422105 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.422105 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.422782 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.422782 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.422782 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.423151 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.423371 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.423667 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.423973 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.424262 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 12:35:44.424712 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.424871 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 12:35:44.424957 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.424957 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.425247 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 12:35:44.425375 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.425375 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.425624 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 12:35:44.425624 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 12:35:44.425888 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.426014 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.426106 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.426336 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.426446 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.426591 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.426741 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.426857 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.426983 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.427679 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.427972 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.428152 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.428297 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.428447 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.428590 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.428735 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.428960 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.429136 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.429276 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.429378 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.429655 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.429889 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.430038 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.430338 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.430502 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.430657 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815712-9-iscsi {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.430823 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.430985 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.430985 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.431257 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.431403 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.431403 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.431687 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.431846 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.431989 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.432131 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.432276 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.432514 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.432700 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.433014 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.433227 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.433375 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.433616 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.433868 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.41 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.434078 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.434248 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.41 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.434406 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.434638 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.434800 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.435061 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.435219 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.435379 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.435613 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.435833 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.435995 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.436243 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.436397 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815712-9-iscsi {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.436725 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.436901 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.437077 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.437277 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.437427 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.437786 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.438020 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.438216 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.438361 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.438533 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.438817 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.438969 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.439175 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.439366 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.439530 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.439799 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.439960 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.440115 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.440388 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.440564 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.440736 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.440882 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.441145 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.441294 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.441458 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.441785 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.441953 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.442109 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.442341 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.442492 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.442726 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.442875 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.443074 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.443369 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.443522 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.443699 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.443907 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.444129 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.444332 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.444483 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.444636 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.444825 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.444982 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.445126 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.445423 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.445589 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.445836 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.446013 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.446156 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.446367 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.446512 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.446654 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.446956 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.447122 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.447275 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.447482 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.447633 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.447838 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.448028 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.448175 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.448456 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.448589 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.448796 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.449019 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.449220 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.449402 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.449590 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.449805 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.41 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.450034 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.41 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.450239 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.450454 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.450646 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.450823 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.451014 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.452795 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.452973 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.453104 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.453233 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.453399 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.453601 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.453863 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.454010 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.454010 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.454434 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.454628 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.454820 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.454981 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.454981 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.455242 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.455400 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.455400 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.455670 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.455870 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.455870 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.456203 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.456346 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.456346 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.456619 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.456760 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.456760 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.457107 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.457252 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.457393 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.457547 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.457547 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.457856 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.458011 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.458011 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.458272 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.458412 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.458412 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.458697 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.458839 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.458979 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.459192 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.459460 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.459634 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.459817 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.459998 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.460146 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.460443 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.460606 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.460838 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.460986 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.461325 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.461491 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.461737 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.461970 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.462148 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.462446 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.462616 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.462918 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.463072 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.463378 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.463548 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.463889 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.464094 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.464412 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.464631 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.464904 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.465078 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.465267 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.465440 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.465588 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.465924 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.466075 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.466307 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.466463 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.466606 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.466842 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.467020 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.467183 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.467448 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.467596 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.467739 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.468048 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.468213 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.468369 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.468580 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.468732 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.468935 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.469144 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.469296 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.469562 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.469760 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.469922 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.470181 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.470328 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.470470 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.470740 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.470904 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.471076 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.471284 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.471435 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:35:44.471725 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.471886 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.472040 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.472289 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.472426 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.472683 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.472835 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.473076 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.473297 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.473432 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.473859 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.474522 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.474672 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.474901 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.475037 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.475227 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.475529 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.475682 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.475809 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.476055 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.476230 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.476437 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.476570 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.476751 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.477024 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.477172 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.477380 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.477593 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.477817 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.478021 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.478244 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.478384 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.478634 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.478787 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.478941 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.479204 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.479361 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.479573 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.479745 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.479895 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.480241 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.480412 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.480556 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.480799 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.480953 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.481207 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.481397 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.481564 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.481841 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.481990 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.482185 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.482398 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.482571 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.482831 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.482992 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.483137 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.483407 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.483559 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.483910 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.484133 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.484278 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.484427 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.484570 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.484774 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.485005 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.485156 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.485415 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.485563 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.485735 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.486308 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.486485 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.486624 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.486840 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.486976 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.487336 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.487492 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.487701 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.487882 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.488057 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.488280 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.488425 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.488673 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.488907 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.489228 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.489404 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.490371 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.490525 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.490930 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.491085 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.491404 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.491570 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.491892 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.492099 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.492393 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.492578 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.492826 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.492976 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.493130 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.493400 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.493568 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.493780 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.493970 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.494256 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.494488 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.494686 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.494974 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.495185 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.495465 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.495719 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.495988 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.496234 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.496467 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.496619 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.496956 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.497111 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.497317 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.497478 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.497650 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.497990 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.498210 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.498399 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.498552 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.498718 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.498914 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.499060 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.499236 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.499547 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.499717 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.499897 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.500090 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.500252 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.500572 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.500730 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.500998 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.501150 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.501296 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.501582 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.501776 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.501922 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.502136 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.502289 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.502550 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.502698 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.502870 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.503139 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.503306 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.503529 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.503687 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.503833 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.504134 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.504352 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.504502 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.504780 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.504935 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.505080 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.505242 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.505408 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.505688 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.505840 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.505983 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.506283 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.506447 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.506605 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.506820 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.506973 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.507192 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.507350 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.507494 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.507787 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.507984 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.508132 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.508381 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.508534 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.508755 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.508903 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.509099 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.509398 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.509550 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.509781 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.509995 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.510146 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.510379 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.510535 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.510679 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.510994 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.511155 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.511309 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.511536 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.511689 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.511912 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.512071 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.512234 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.512533 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.512683 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.512826 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.513047 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.513262 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.513546 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.513726 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.513938 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.514098 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.514253 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.514558 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.514708 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.514899 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.515112 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.515266 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.515545 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.515714 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.515844 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.516110 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.516318 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.516500 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.516680 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.516885 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.517068 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.517225 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.517369 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.517644 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.517891 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.518055 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.518195 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.518352 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.518605 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.518765 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.518923 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.519195 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.519350 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.519526 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.519722 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.519859 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.520140 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.520289 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.520446 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.521312 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.521468 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.521596 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.521859 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.522013 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.522237 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.522438 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.522587 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.522860 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.523016 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.523174 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.523459 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.523614 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.523770 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.524008 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.524161 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.524366 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.524563 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.524721 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.524977 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.525122 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.525266 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.525598 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.525795 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.525957 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.526128 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.526291 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.526595 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.526729 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.526947 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.527145 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.527295 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.527530 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.527677 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.527832 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.528149 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.528301 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.528457 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.528681 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.528844 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.529100 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.529261 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.529414 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.529696 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.529865 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.530011 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.530268 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.530421 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.530576 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.530810 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.530959 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.531213 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.531360 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.531504 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.531796 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.531964 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.532119 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.532335 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.532487 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.532732 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.532893 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.533040 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.533343 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.533492 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.533647 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.533923 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.534104 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.534303 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.534473 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.534620 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.534916 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.535066 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.535224 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.535459 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.535641 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.535943 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.536102 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.536245 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.537030 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.537236 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.537425 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.537569 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.537788 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.538069 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.538353 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.538499 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.538652 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.538965 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.539116 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.539280 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.539571 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.539726 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.539910 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.540106 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.540268 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.540541 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.540689 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.540875 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.541151 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.541305 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.541540 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.541746 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.541917 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.542191 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.542356 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.542583 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.542729 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.542872 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.543196 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.543346 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.543501 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.543751 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.543907 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.544084 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.544289 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.544426 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.544689 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.544832 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.544991 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.545270 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.545409 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.545589 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.545843 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.545993 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.546220 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.546365 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.546533 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.546820 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.546959 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.547219 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.547353 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.547503 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.547777 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.547931 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.548073 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.548336 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.548546 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.548686 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.548985 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.549207 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.549414 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.549632 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.549896 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.550044 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.550188 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.550338 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.550490 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.550632 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.550888 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.551052 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.551261 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.551455 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.551605 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.551750 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.551984 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.552178 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.552387 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.552534 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.552679 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.552987 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.553149 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.553294 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.553534 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.553713 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.553928 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.554095 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.554241 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.554527 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.554677 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.554831 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.555105 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.555279 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.555452 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.555639 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.555869 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.556059 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.556200 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.556364 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.556665 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.556817 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.556972 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.557193 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.557346 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.557552 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.557789 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.557983 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.558249 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.558401 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.558587 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.558795 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.558961 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.559182 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.559336 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.559494 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.559779 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.559933 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.560078 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.560302 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.560454 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.560690 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.560853 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.560996 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.561293 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.561444 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.561588 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.561855 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.562027 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.562339 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.562494 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.562807 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.562962 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.563283 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.563448 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.563742 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.563894 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.564203 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.564355 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.564635 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.564787 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.564929 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.565210 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.565425 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.565571 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.565786 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.565950 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.566165 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.566311 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.566455 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.566777 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.566982 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.567284 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.567453 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.567809 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.567966 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.568311 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.568479 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.568793 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.568970 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.569113 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.569329 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.569481 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.569784 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.569912 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.570236 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.570384 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.570909 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.571074 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.571385 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.571610 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.571916 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.572153 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.572455 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.572813 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.573031 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.573243 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.573545 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.573873 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.574135 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.574348 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.574594 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.574804 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.575015 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.575223 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.575464 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.575691 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.575923 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.576138 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.576138 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.576544 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.576767 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.576767 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.577174 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.577380 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.577380 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.577852 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.578000 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.578164 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.578309 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.578483 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.578626 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.578769 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.578911 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.579096 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.579247 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.579528 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.579677 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.579832 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.580091 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.580261 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.580479 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.580632 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.580790 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.581090 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.581259 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.581404 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.581603 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.581777 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.582017 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.582163 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.582320 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.582622 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.582785 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.582929 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.583138 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.583809 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.584182 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.584339 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.584639 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.584790 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.584946 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.585215 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.585384 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.585720 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.585906 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.586174 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.586309 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.586567 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.586732 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.586866 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.587072 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.587354 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.587539 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.587842 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.588073 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.588304 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.588518 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.588732 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.588962 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.589186 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.589406 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.589596 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.589885 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.590054 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.590198 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.590421 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.590584 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.590742 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.590898 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.591045 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.591303 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.591459 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.591656 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.591826 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.591980 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.592262 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.592434 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.592580 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.592813 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.592967 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.593270 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.593422 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.593581 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.593828 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.594030 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.594306 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.594461 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.594638 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.594848 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.595058 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.595342 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.595496 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.595669 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.595877 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.596030 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.596306 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.596456 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.596612 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.596854 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.597022 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.597224 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.597380 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.597524 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.597873 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.598027 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.598181 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.598431 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.598583 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.598798 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.598995 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.599654 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.599973 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.600130 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.600317 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.600504 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.600669 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.600941 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.601092 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.601360 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.601511 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.601730 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.602015 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.615005 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.615259 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.615418 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.615620 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.615773 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.615873 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.615967 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.616037 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.616102 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.616179 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.616257 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.616334 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.616422 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.616503 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.616580 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.616658 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.616735 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.616822 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.616910 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.616990 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.617067 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.617173 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.617289 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.617371 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.617438 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.617551 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.617689 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.617780 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.617862 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.618101 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.618192 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.618291 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.618392 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.618524 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.618614 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.618704 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.618785 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.618852 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.618958 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.619058 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.619157 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.619263 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.619401 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.619555 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.619701 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.619845 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.620012 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.620137 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.620269 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.620356 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.620429 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.620564 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.620711 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.620846 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.620984 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.621125 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.621264 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.621264 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.621532 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.621694 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.621896 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.622039 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.622126 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.622255 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.622355 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.622464 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.622571 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.622700 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.622841 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.623009 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.623158 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.623316 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.623464 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.623611 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.623775 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.623934 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.624083 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.624231 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.624391 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.624539 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.624642 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.624721 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.624794 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.624867 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.624932 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.625003 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.625077 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.625156 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.625221 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.625297 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.625397 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.625543 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.625739 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.625889 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.625989 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.626070 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.626137 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.626234 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.626472 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.626622 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.626768 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.626886 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.626886 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.627151 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.627297 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.627297 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.627465 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.627586 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.627718 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.627852 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.627852 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.628112 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.628264 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.628264 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.628511 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.628657 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.628657 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.628914 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.629074 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.629074 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.629405 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.629540 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.629702 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.629853 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.629853 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.630112 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.630261 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.630381 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.630520 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.630666 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.630795 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.630937 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.631088 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.631088 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.631345 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.631494 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.631494 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.631753 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.631897 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.632047 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.632191 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.632191 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.632454 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.632592 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.632742 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.632868 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.633007 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.633007 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.633276 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.633418 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.633574 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.633739 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.633900 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.634042 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.634182 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.634182 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.634452 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.634593 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.634593 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.634873 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.634996 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.634996 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.635261 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.635261 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.635511 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.635648 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.635788 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.635788 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.636045 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.636208 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.636351 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.636492 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.636632 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.636780 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.636930 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.637093 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.637244 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.637383 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.637522 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.637758 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.637905 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.638032 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.638104 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.638215 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.638297 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.638363 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.638438 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.638505 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.638505 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.638647 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.638647 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.638774 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.638848 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.638920 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.638920 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.639045 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.639045 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.639159 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.639231 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.639299 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.639369 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.639440 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.639532 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.639609 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.639691 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.639767 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.639767 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.639899 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.639963 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.640036 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.640154 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.640249 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.640317 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.640381 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.640444 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.640522 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.640589 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.640653 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.640730 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.640797 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.640869 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.640937 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.641000 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.641071 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.641136 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.641208 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.641297 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.641379 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.641446 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.641517 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.641592 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.641750 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.641849 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.641925 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.641990 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.642054 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.642117 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.642189 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.642255 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.642255 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.642369 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.642433 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.642506 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.642588 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.642663 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.642729 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.642729 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.642844 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.642906 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.642994 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.643082 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.643183 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.643271 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.643339 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.643409 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.643409 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.643563 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.643693 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.643785 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.643993 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.644091 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.644329 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.645295 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.645399 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.645470 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.645535 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.646645 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.647255 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.647369 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.647504 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.647673 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.647885 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.647885 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.648127 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.648220 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.648360 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.648508 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.648658 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.648875 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.648875 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.649035 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.649179 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.649179 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.649484 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.649632 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.649795 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.649929 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.650098 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.650259 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.650422 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.650507 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.650588 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.650715 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.650864 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.651072 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.651224 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.651335 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.651494 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.651646 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.651796 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.651927 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.652028 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.652105 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.652219 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.652358 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.652504 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.652650 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.652650 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.652910 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.653004 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.653099 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.653237 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.653397 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.653555 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.653730 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.653833 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.653833 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.653970 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.654130 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.654283 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.654431 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.654578 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.654727 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.654819 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.655022 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.655184 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.655331 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.655474 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.655624 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.655848 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.656022 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.656171 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.656282 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.656369 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.656503 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.656801 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.656968 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.657104 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.657216 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.657412 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.657574 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.657847 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.657947 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.658066 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.658357 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.658548 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.658693 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.658848 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.658988 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.659125 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.659259 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.659393 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.659574 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.659714 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.659895 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.660033 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.660186 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.660338 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.660514 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.660650 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.660782 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.660915 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.661102 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.661247 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.661533 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.663046 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.663204 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.663442 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.663666 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.663918 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.664099 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.664219 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.664305 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.664459 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.664459 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.664870 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.664870 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.665189 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.665355 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.665507 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.665660 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.665852 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.666001 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.666148 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.666148 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.666420 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.666565 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.666565 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.666859 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.667006 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.667149 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.667295 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.667295 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.667575 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.667720 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.667720 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.668000 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.668146 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.668361 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.668524 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.668685 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.668829 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.668987 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.669132 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.669365 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.669520 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.669762 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.669940 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.670109 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.670375 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.670538 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.670685 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.670987 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.671140 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.671308 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.671548 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.671722 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.671922 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.672093 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.672246 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.672564 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.672736 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.672963 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.673174 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.673380 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.673596 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.673975 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.674122 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.674267 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.674409 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.674552 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.674707 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.674938 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.675091 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.675402 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.675552 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.675696 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.675928 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.676095 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.676321 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.676480 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.676625 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.676927 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.677623 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.677894 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.678055 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.678201 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.678507 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.678691 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.678855 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.678992 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.679139 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.679421 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.679565 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.679763 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.679914 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.680088 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.680339 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.680486 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.680689 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.680954 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.681118 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.681251 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.681395 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.681592 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.681773 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.681912 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.682221 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.682357 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.682552 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.682699 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.682845 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.683100 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.683236 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.683416 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.683720 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.683885 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.684012 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.684318 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.684455 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.684605 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.684817 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.684976 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.685298 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.685439 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.685568 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.685808 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.685944 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.686112 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.686276 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.686407 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.686712 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.686849 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.687001 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.687209 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.687366 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.687593 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.687740 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.687898 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.688094 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.688230 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.688535 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.688721 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.688875 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.689071 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.689224 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.689453 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.689592 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.689795 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.690035 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.690185 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.690419 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.690641 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.690782 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.690915 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.691042 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.691341 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.691489 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.691672 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.691812 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.692002 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.692284 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.692560 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.692758 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.693695 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.693909 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.694051 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.694186 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.694336 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.694483 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.694646 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.694779 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.695087 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.695223 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.695412 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.695571 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.695733 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.695982 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.696131 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.696357 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.696474 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.696669 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.696887 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.697225 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.697366 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.697613 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.697818 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.697952 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.698182 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.698321 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.698564 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.698779 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.698935 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.699070 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.699203 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.699493 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.699637 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.699820 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.699970 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.700147 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.700386 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.700535 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.700778 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.700912 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.701104 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.701269 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.701456 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.701785 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.701935 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.702143 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.702283 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.702478 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.702689 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.702827 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.703120 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.703279 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.703413 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.703656 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.703785 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 12:35:44.704117 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.704503 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.704881 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.705258 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.705645 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.706052 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.706430 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.706802 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.707186 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.707562 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.707942 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.708419 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.708846 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.709231 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.709619 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.710057 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.710441 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.710837 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.711231 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.711611 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.712034 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.712473 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.713119 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.713524 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.714034 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.714445 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.714861 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.715247 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.715631 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.716017 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.716415 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.716803 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.717187 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.717576 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.717986 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.718366 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.718748 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.719195 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.719582 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.719979 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.720362 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.720749 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.721137 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.721520 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.721945 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.722401 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.722813 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.723205 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.723589 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.724062 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.724448 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.724843 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.725217 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.725600 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.726016 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.726416 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.726795 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.727171 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.727670 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.728052 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.728441 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.728829 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.729331 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.729742 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.730191 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.730820 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.731218 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.731607 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.732005 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.732420 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.732851 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.733253 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.733636 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.734101 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.734536 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.734968 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.735422 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.736118 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.736539 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.736973 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.737401 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.737872 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.738284 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.738692 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.739096 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.740037 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.740443 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.740852 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.741249 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.741649 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.742074 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.742471 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.742932 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.743347 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.743753 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.744278 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.744574 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.744931 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.745325 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.745732 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.746137 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.746535 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.746922 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.747312 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.747689 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.748081 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.748470 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.748864 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.749254 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.749659 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.750679 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.751084 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.751494 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.751874 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.752262 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.752647 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.753107 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.753500 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.753906 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.758096 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.758096 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.758096 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.758096 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.758096 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.758096 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.758096 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.758096 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.759063 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.759063 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.759063 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.759063 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.759497 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.759799 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.760201 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.760583 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.760979 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.761375 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.761835 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.762222 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.762649 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.763085 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.763476 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.763853 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.764228 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:35:44.764598 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 12:35:44.770102 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: INFO dbcounter [None req-72a811e2-4bb7-4c0c-b505-c5357987f86c None None] Registered counter for database nova_api May 26 12:35:44.799089 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG oslo_db.sqlalchemy.engines [None req-72a811e2-4bb7-4c0c-b505-c5357987f86c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110284) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 12:35:44.809486 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG dbcounter [-] [110284] Writer thread running {{(pid=110284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 12:35:44.824875 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: INFO dbcounter [None req-62f31359-e299-4727-8d62-927f85a3869d None None] Registered counter for database nova_api May 26 12:35:44.847005 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG oslo_db.sqlalchemy.engines [None req-62f31359-e299-4727-8d62-927f85a3869d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110285) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 12:35:44.857134 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG dbcounter [-] [110285] Writer thread running {{(pid=110285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 12:35:44.871353 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.context [None req-72a811e2-4bb7-4c0c-b505-c5357987f86c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8040d8fc-4b5c-4b3f-be84-000e94e5def8(cell1) {{(pid=110284) load_cells /opt/stack/nova/nova/context.py:464}} May 26 12:35:44.875493 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG oslo_concurrency.lockutils [None req-72a811e2-4bb7-4c0c-b505-c5357987f86c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:44.877058 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG oslo_concurrency.lockutils [None req-72a811e2-4bb7-4c0c-b505-c5357987f86c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:44.877882 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG oslo_concurrency.lockutils [None req-72a811e2-4bb7-4c0c-b505-c5357987f86c None None] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:44.879844 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG oslo_concurrency.lockutils [None req-72a811e2-4bb7-4c0c-b505-c5357987f86c None None] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:44.882260 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: INFO dbcounter [None req-72a811e2-4bb7-4c0c-b505-c5357987f86c None None] Registered counter for database nova_cell0 May 26 12:35:44.886471 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: INFO dbcounter [None req-72a811e2-4bb7-4c0c-b505-c5357987f86c None None] Registered counter for database nova_cell1 May 26 12:35:44.895561 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG oslo_db.sqlalchemy.engines [None req-72a811e2-4bb7-4c0c-b505-c5357987f86c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110284) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 12:35:44.897576 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG oslo_db.sqlalchemy.engines [None req-72a811e2-4bb7-4c0c-b505-c5357987f86c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110284) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 12:35:44.904796 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG dbcounter [-] [110284] Writer thread running {{(pid=110284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 12:35:44.906607 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG dbcounter [-] [110284] Writer thread running {{(pid=110284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 12:35:44.916801 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.context [None req-62f31359-e299-4727-8d62-927f85a3869d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8040d8fc-4b5c-4b3f-be84-000e94e5def8(cell1) {{(pid=110285) load_cells /opt/stack/nova/nova/context.py:464}} May 26 12:35:44.920904 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG oslo_concurrency.lockutils [None req-62f31359-e299-4727-8d62-927f85a3869d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:44.922540 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG oslo_concurrency.lockutils [None req-62f31359-e299-4727-8d62-927f85a3869d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:44.923336 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG oslo_concurrency.lockutils [None req-62f31359-e299-4727-8d62-927f85a3869d None None] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:35:44.925309 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG oslo_concurrency.lockutils [None req-62f31359-e299-4727-8d62-927f85a3869d None None] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:35:44.928569 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: INFO dbcounter [None req-62f31359-e299-4727-8d62-927f85a3869d None None] Registered counter for database nova_cell0 May 26 12:35:44.932995 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: INFO dbcounter [None req-62f31359-e299-4727-8d62-927f85a3869d None None] Registered counter for database nova_cell1 May 26 12:35:44.941536 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG oslo_db.sqlalchemy.engines [None req-62f31359-e299-4727-8d62-927f85a3869d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110285) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 12:35:44.943606 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG oslo_db.sqlalchemy.engines [None req-62f31359-e299-4727-8d62-927f85a3869d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110285) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 12:35:44.950631 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG dbcounter [-] [110285] Writer thread running {{(pid=110285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 12:35:44.952569 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG dbcounter [-] [110285] Writer thread running {{(pid=110285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 12:35:45.058711 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: INFO dbcounter [None req-72a811e2-4bb7-4c0c-b505-c5357987f86c None None] Registered counter for database nova_cell0 May 26 12:35:45.071177 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG oslo_db.sqlalchemy.engines [None req-72a811e2-4bb7-4c0c-b505-c5357987f86c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110284) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 12:35:45.077379 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG dbcounter [-] [110284] Writer thread running {{(pid=110284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 12:35:45.107901 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: INFO dbcounter [None req-62f31359-e299-4727-8d62-927f85a3869d None None] Registered counter for database nova_cell0 May 26 12:35:45.118580 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG oslo_db.sqlalchemy.engines [None req-62f31359-e299-4727-8d62-927f85a3869d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110285) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 12:35:45.123297 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG dbcounter [-] [110285] Writer thread running {{(pid=110285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 12:35:45.521514 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: WARNING keystonemiddleware.auth_token [None req-72a811e2-4bb7-4c0c-b505-c5357987f86c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 12:35:45.528841 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: WARNING keystonemiddleware.auth_token [None req-72a811e2-4bb7-4c0c-b505-c5357987f86c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 12:35:45.595011 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: WARNING keystonemiddleware.auth_token [None req-62f31359-e299-4727-8d62-927f85a3869d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 12:35:45.603182 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: WARNING keystonemiddleware.auth_token [None req-62f31359-e299-4727-8d62-927f85a3869d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 12:35:45.876320 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: WARNING keystonemiddleware.auth_token [None req-72a811e2-4bb7-4c0c-b505-c5357987f86c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 12:35:45.883154 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: WARNING keystonemiddleware.auth_token [None req-72a811e2-4bb7-4c0c-b505-c5357987f86c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 12:35:45.888472 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a1b47659c0 pid: 110284 (default app) May 26 12:35:45.890743 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi [None req-72a811e2-4bb7-4c0c-b505-c5357987f86c None None] Calling method '>' {{(pid=110284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:35:45.891975 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: INFO nova.api.openstack.requestlog [None req-72a811e2-4bb7-4c0c-b505-c5357987f86c None None] 10.222.0.41 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001954 May 26 12:35:45.892716 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: [pid: 110284|app: 0|req: 1/1] 10.222.0.41 () {50 vars in 788 bytes} [Thu May 26 12:35:45 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:35:45.952892 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: WARNING keystonemiddleware.auth_token [None req-62f31359-e299-4727-8d62-927f85a3869d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 12:35:45.959572 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: WARNING keystonemiddleware.auth_token [None req-62f31359-e299-4727-8d62-927f85a3869d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 12:35:45.964937 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a1b47659c0 pid: 110285 (default app) May 26 12:37:15.784017 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi [None req-72a811e2-4bb7-4c0c-b505-c5357987f86c None None] Calling method '>' {{(pid=110284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:37:15.788623 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: INFO nova.api.openstack.requestlog [None req-72a811e2-4bb7-4c0c-b505-c5357987f86c None None] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002013 May 26 12:37:15.791381 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: [pid: 110284|app: 0|req: 2/2] 10.222.0.41 () {54 vars in 930 bytes} [Thu May 26 12:37:15 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:37:15.798893 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG dbcounter [-] [110285] Writing DB stats nova_api:SELECT=3 {{(pid=110285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:37:15.799738 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG dbcounter [-] [110285] Writing DB stats nova_cell1:SELECT=3 {{(pid=110285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:37:15.800761 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG dbcounter [-] [110285] Writing DB stats nova_cell0:SELECT=3 {{(pid=110285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:37:15.801903 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG dbcounter [-] [110285] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:37:16.282871 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi [None req-821d7991-4cd4-496f-969d-02127cf22a92 admin admin] Calling method '>' {{(pid=110285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:37:16.322783 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: INFO nova.api.openstack.requestlog [None req-821d7991-4cd4-496f-969d-02127cf22a92 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.529527 May 26 12:37:16.327254 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: [pid: 110285|app: 0|req: 1/3] 10.222.0.41 () {60 vars in 1291 bytes} [Thu May 26 12:37:15 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:37:18.703281 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi [None req-72a811e2-4bb7-4c0c-b505-c5357987f86c None None] Calling method '>' {{(pid=110284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:37:18.704862 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: INFO nova.api.openstack.requestlog [None req-72a811e2-4bb7-4c0c-b505-c5357987f86c None None] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002035 May 26 12:37:18.705538 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: [pid: 110284|app: 0|req: 3/4] 10.222.0.41 () {54 vars in 930 bytes} [Thu May 26 12:37:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:37:18.773221 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi [None req-051ce332-d304-4c98-b7f8-fa66ead4deb5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "name": "cirros256", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "disk": 1, "ram": 256, "rxtx_factor": 1.0, "swap": 0}} {{(pid=110285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:37:18.792607 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 12:37:18.792607 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: warnings.warn(msg) May 26 12:37:18.980791 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: INFO nova.api.openstack.requestlog [None req-051ce332-d304-4c98-b7f8-fa66ead4deb5 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.268291 May 26 12:37:18.986432 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: [pid: 110285|app: 0|req: 2/5] 10.222.0.41 () {64 vars in 1282 bytes} [Thu May 26 12:37:18 2022] POST /compute/v2.1/flavors => generated 407 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 12:37:18.995733 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG dbcounter [-] [110284] Writing DB stats nova_api:SELECT=3 {{(pid=110284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:37:18.996561 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG dbcounter [-] [110284] Writing DB stats nova_cell0:SELECT=3 {{(pid=110284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:37:18.998014 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG dbcounter [-] [110284] Writing DB stats nova_cell1:SELECT=3 {{(pid=110284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:37:18.998888 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG dbcounter [-] [110284] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:37:19.228922 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi [None req-42ea72d7-5eaa-4ee0-b805-960427a3c118 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:37:19.231528 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 12:37:19.231528 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: warnings.warn(msg) May 26 12:37:19.598595 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: INFO nova.api.openstack.requestlog [None req-42ea72d7-5eaa-4ee0-b805-960427a3c118 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.608083 May 26 12:37:19.599271 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: [pid: 110284|app: 0|req: 4/6] 10.222.0.41 () {64 vars in 1335 bytes} [Thu May 26 12:37:18 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:37:21.969023 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi [None req-051ce332-d304-4c98-b7f8-fa66ead4deb5 admin admin] Calling method '>' {{(pid=110285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:37:21.970183 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: INFO nova.api.openstack.requestlog [None req-051ce332-d304-4c98-b7f8-fa66ead4deb5 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 May 26 12:37:21.970887 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: [pid: 110285|app: 0|req: 3/7] 10.222.0.41 () {54 vars in 930 bytes} [Thu May 26 12:37:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:37:22.119941 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi [None req-0c622d20-c8e1-4075-885f-54918f45ca9e admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "id": "d1", "disk": 5, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 512, "swap": 0, "vcpus": 1}} {{(pid=110284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:37:22.139429 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 12:37:22.139429 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: warnings.warn(msg) May 26 12:37:22.266348 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: INFO nova.api.openstack.requestlog [None req-0c622d20-c8e1-4075-885f-54918f45ca9e admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.288201 May 26 12:37:22.267312 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: [pid: 110284|app: 0|req: 5/8] 10.222.0.41 () {64 vars in 1282 bytes} [Thu May 26 12:37:21 2022] POST /compute/v2.1/flavors => generated 404 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 12:37:22.280442 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi [None req-e263fba2-4c9a-41ca-bc66-9c0d6e2ed521 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:37:22.282129 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 12:37:22.282129 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: warnings.warn(msg) May 26 12:37:22.500184 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: INFO nova.api.openstack.requestlog [None req-e263fba2-4c9a-41ca-bc66-9c0d6e2ed521 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.223844 May 26 12:37:22.501124 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: [pid: 110285|app: 0|req: 4/9] 10.222.0.41 () {64 vars in 1335 bytes} [Thu May 26 12:37:22 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:37:24.836141 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi [None req-0c622d20-c8e1-4075-885f-54918f45ca9e admin admin] Calling method '>' {{(pid=110284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:37:24.837781 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: INFO nova.api.openstack.requestlog [None req-0c622d20-c8e1-4075-885f-54918f45ca9e admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002256 May 26 12:37:24.838428 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: [pid: 110284|app: 0|req: 6/10] 10.222.0.41 () {54 vars in 930 bytes} [Thu May 26 12:37:24 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:37:24.906350 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi [None req-548968e9-f348-4107-9196-4bf20058824c admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "ds1G", "swap": 0, "rxtx_factor": 1.0, "disk": 10, "ram": 1024, "vcpus": 1, "id": "d2"}} {{(pid=110285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:37:25.034857 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: INFO nova.api.openstack.requestlog [None req-548968e9-f348-4107-9196-4bf20058824c admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.189154 May 26 12:37:25.035908 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: [pid: 110285|app: 0|req: 5/11] 10.222.0.41 () {64 vars in 1282 bytes} [Thu May 26 12:37:24 2022] POST /compute/v2.1/flavors => generated 404 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 12:37:25.052739 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi [None req-6db0e9c2-03db-4100-95a7-648cb6775f4c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:37:25.194596 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: INFO nova.api.openstack.requestlog [None req-6db0e9c2-03db-4100-95a7-648cb6775f4c admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.148567 May 26 12:37:25.195302 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: [pid: 110284|app: 0|req: 7/12] 10.222.0.41 () {64 vars in 1335 bytes} [Thu May 26 12:37:25 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:37:27.576332 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi [None req-548968e9-f348-4107-9196-4bf20058824c admin admin] Calling method '>' {{(pid=110285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:37:27.577359 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: INFO nova.api.openstack.requestlog [None req-548968e9-f348-4107-9196-4bf20058824c admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 May 26 12:37:27.577792 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: [pid: 110285|app: 0|req: 6/13] 10.222.0.41 () {54 vars in 930 bytes} [Thu May 26 12:37:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:37:27.644152 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi [None req-54d38807-8dae-4e65-9e4d-c26009f97a11 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "os-flavor-access:is_public": true, "ram": 2048, "swap": 0, "id": "d3", "disk": 10, "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=110284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:37:27.807944 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: INFO nova.api.openstack.requestlog [None req-54d38807-8dae-4e65-9e4d-c26009f97a11 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.223161 May 26 12:37:27.808503 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: [pid: 110284|app: 0|req: 8/14] 10.222.0.41 () {64 vars in 1282 bytes} [Thu May 26 12:37:27 2022] POST /compute/v2.1/flavors => generated 404 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 12:37:27.821310 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi [None req-5f35eb85-c422-4526-b7ab-e5a28a0b6368 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:37:28.097689 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: INFO nova.api.openstack.requestlog [None req-5f35eb85-c422-4526-b7ab-e5a28a0b6368 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.280240 May 26 12:37:28.098300 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: [pid: 110285|app: 0|req: 7/15] 10.222.0.41 () {64 vars in 1335 bytes} [Thu May 26 12:37:27 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:37:30.460688 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi [None req-54d38807-8dae-4e65-9e4d-c26009f97a11 admin admin] Calling method '>' {{(pid=110284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:37:30.461985 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: INFO nova.api.openstack.requestlog [None req-54d38807-8dae-4e65-9e4d-c26009f97a11 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001743 May 26 12:37:30.462379 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: [pid: 110284|app: 0|req: 9/16] 10.222.0.41 () {54 vars in 930 bytes} [Thu May 26 12:37:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:37:30.535878 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi [None req-79060180-2b58-4dd3-aeb6-1697bb927be2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "ram": 4096, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 4, "swap": 0, "name": "ds4G"}} {{(pid=110285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:37:30.709750 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: INFO nova.api.openstack.requestlog [None req-79060180-2b58-4dd3-aeb6-1697bb927be2 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.236461 May 26 12:37:30.709750 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: [pid: 110285|app: 0|req: 8/17] 10.222.0.41 () {64 vars in 1282 bytes} [Thu May 26 12:37:30 2022] POST /compute/v2.1/flavors => generated 404 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 12:37:30.721248 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi [None req-9605cbe2-c53b-4e2c-9600-8ce0e11ddc34 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:37:30.897354 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: INFO nova.api.openstack.requestlog [None req-9605cbe2-c53b-4e2c-9600-8ce0e11ddc34 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.179893 May 26 12:37:30.898061 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: [pid: 110284|app: 0|req: 10/18] 10.222.0.41 () {64 vars in 1335 bytes} [Thu May 26 12:37:30 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:37:33.261064 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi [None req-79060180-2b58-4dd3-aeb6-1697bb927be2 admin admin] Calling method '>' {{(pid=110285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:37:33.262127 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: INFO nova.api.openstack.requestlog [None req-79060180-2b58-4dd3-aeb6-1697bb927be2 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001533 May 26 12:37:33.262526 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: [pid: 110285|app: 0|req: 9/19] 10.222.0.41 () {54 vars in 930 bytes} [Thu May 26 12:37:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:37:33.333713 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi [None req-b0c051fc-2609-41d8-a0ec-0e57d06f93cb admin admin] Calling method '>' {{(pid=110284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:37:33.359611 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: INFO nova.api.openstack.requestlog [None req-b0c051fc-2609-41d8-a0ec-0e57d06f93cb admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.089763 May 26 12:37:33.360272 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: [pid: 110284|app: 0|req: 11/20] 10.222.0.41 () {60 vars in 1291 bytes} [Thu May 26 12:37:33 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:37:35.856356 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi [None req-79060180-2b58-4dd3-aeb6-1697bb927be2 admin admin] Calling method '>' {{(pid=110285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:37:35.857528 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: INFO nova.api.openstack.requestlog [None req-79060180-2b58-4dd3-aeb6-1697bb927be2 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 May 26 12:37:35.857985 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: [pid: 110285|app: 0|req: 10/21] 10.222.0.41 () {54 vars in 930 bytes} [Thu May 26 12:37:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:37:35.936615 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi [None req-8a55fbb4-4d06-4076-a555-402be60fb47b admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 1, "disk": 1, "ram": 512, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "id": "1"}} {{(pid=110284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:37:36.090790 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: INFO nova.api.openstack.requestlog [None req-8a55fbb4-4d06-4076-a555-402be60fb47b admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.223885 May 26 12:37:36.091518 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: [pid: 110284|app: 0|req: 12/22] 10.222.0.41 () {64 vars in 1282 bytes} [Thu May 26 12:37:35 2022] POST /compute/v2.1/flavors => generated 402 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 12:37:36.110063 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi [None req-3d39d6c2-130a-4cef-be95-dd9da04d64f3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:37:36.236720 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: INFO nova.api.openstack.requestlog [None req-3d39d6c2-130a-4cef-be95-dd9da04d64f3 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.133012 May 26 12:37:36.237445 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: [pid: 110285|app: 0|req: 11/23] 10.222.0.41 () {64 vars in 1332 bytes} [Thu May 26 12:37:36 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:37:38.869867 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi [None req-8a55fbb4-4d06-4076-a555-402be60fb47b admin admin] Calling method '>' {{(pid=110284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:37:38.870970 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: INFO nova.api.openstack.requestlog [None req-8a55fbb4-4d06-4076-a555-402be60fb47b admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001916 May 26 12:37:38.871444 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: [pid: 110284|app: 0|req: 13/24] 10.222.0.41 () {54 vars in 930 bytes} [Thu May 26 12:37:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:37:38.976125 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi [None req-fdee33bb-9268-4252-8a34-1c467ad2a0e5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "vcpus": 1, "disk": 20, "name": "m1.small", "ram": 2048, "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=110285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:37:39.080185 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: INFO nova.api.openstack.requestlog [None req-fdee33bb-9268-4252-8a34-1c467ad2a0e5 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.198795 May 26 12:37:39.081542 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: [pid: 110285|app: 0|req: 12/25] 10.222.0.41 () {64 vars in 1282 bytes} [Thu May 26 12:37:38 2022] POST /compute/v2.1/flavors => generated 405 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 12:37:39.093699 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi [None req-1efca20e-ca1e-4446-a17c-198b2f61bac4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:37:39.213947 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: INFO nova.api.openstack.requestlog [None req-1efca20e-ca1e-4446-a17c-198b2f61bac4 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.123824 May 26 12:37:39.215347 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: [pid: 110284|app: 0|req: 14/26] 10.222.0.41 () {64 vars in 1332 bytes} [Thu May 26 12:37:39 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:37:42.057942 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi [None req-fdee33bb-9268-4252-8a34-1c467ad2a0e5 admin admin] Calling method '>' {{(pid=110285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:37:42.059148 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: INFO nova.api.openstack.requestlog [None req-fdee33bb-9268-4252-8a34-1c467ad2a0e5 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001986 May 26 12:37:42.059605 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: [pid: 110285|app: 0|req: 13/27] 10.222.0.41 () {54 vars in 930 bytes} [Thu May 26 12:37:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:37:42.147334 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi [None req-f0edaaae-0dad-4f0a-975b-77580cec1a61 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "disk": 40, "name": "m1.medium", "id": "3", "os-flavor-access:is_public": true, "swap": 0, "vcpus": 2}} {{(pid=110284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:37:42.253578 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: INFO nova.api.openstack.requestlog [None req-f0edaaae-0dad-4f0a-975b-77580cec1a61 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.185848 May 26 12:37:42.254105 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: [pid: 110284|app: 0|req: 15/28] 10.222.0.41 () {64 vars in 1282 bytes} [Thu May 26 12:37:42 2022] POST /compute/v2.1/flavors => generated 406 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 12:37:42.266089 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi [None req-775ac261-2861-458f-af6e-0a7b168b9a1f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:37:42.377200 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: INFO nova.api.openstack.requestlog [None req-775ac261-2861-458f-af6e-0a7b168b9a1f admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.114592 May 26 12:37:42.378215 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: [pid: 110285|app: 0|req: 14/29] 10.222.0.41 () {64 vars in 1332 bytes} [Thu May 26 12:37:42 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:37:44.811825 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi [None req-f0edaaae-0dad-4f0a-975b-77580cec1a61 admin admin] Calling method '>' {{(pid=110284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:37:44.813646 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: INFO nova.api.openstack.requestlog [None req-f0edaaae-0dad-4f0a-975b-77580cec1a61 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002528 May 26 12:37:44.814211 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: [pid: 110284|app: 0|req: 16/30] 10.222.0.41 () {54 vars in 930 bytes} [Thu May 26 12:37:44 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:37:44.882052 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi [None req-731a2cc9-99f5-4003-b7c3-2e5e0c2c2b4b admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "ram": 8192, "vcpus": 4, "name": "m1.large", "disk": 80}} {{(pid=110285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:37:44.990450 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: INFO nova.api.openstack.requestlog [None req-731a2cc9-99f5-4003-b7c3-2e5e0c2c2b4b admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.169462 May 26 12:37:44.991354 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: [pid: 110285|app: 0|req: 15/31] 10.222.0.41 () {64 vars in 1282 bytes} [Thu May 26 12:37:44 2022] POST /compute/v2.1/flavors => generated 405 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 12:37:45.004526 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi [None req-476eb49f-27c4-4549-8575-e3badf8be216 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:37:45.125110 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: INFO nova.api.openstack.requestlog [None req-476eb49f-27c4-4549-8575-e3badf8be216 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.124791 May 26 12:37:45.126370 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: [pid: 110284|app: 0|req: 17/32] 10.222.0.41 () {64 vars in 1332 bytes} [Thu May 26 12:37:44 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:37:47.971198 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi [None req-731a2cc9-99f5-4003-b7c3-2e5e0c2c2b4b admin admin] Calling method '>' {{(pid=110285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:37:47.972921 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: INFO nova.api.openstack.requestlog [None req-731a2cc9-99f5-4003-b7c3-2e5e0c2c2b4b admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002467 May 26 12:37:47.973604 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: [pid: 110285|app: 0|req: 16/33] 10.222.0.41 () {54 vars in 930 bytes} [Thu May 26 12:37:47 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:37:48.069433 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi [None req-aac68b65-1e64-4049-ac1f-57695df75c3c admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "5", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "vcpus": 8, "ram": 16384}} {{(pid=110284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:37:48.197613 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: INFO nova.api.openstack.requestlog [None req-aac68b65-1e64-4049-ac1f-57695df75c3c admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.213969 May 26 12:37:48.198719 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: [pid: 110284|app: 0|req: 18/34] 10.222.0.41 () {64 vars in 1282 bytes} [Thu May 26 12:37:47 2022] POST /compute/v2.1/flavors => generated 408 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 12:37:48.220807 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi [None req-a556c800-ba27-424a-8fe7-4aa0b757a052 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:37:48.229720 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG dbcounter [-] [110285] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=110285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:37:48.377102 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: INFO nova.api.openstack.requestlog [None req-a556c800-ba27-424a-8fe7-4aa0b757a052 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.164089 May 26 12:37:48.382522 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: [pid: 110285|app: 0|req: 17/35] 10.222.0.41 () {64 vars in 1332 bytes} [Thu May 26 12:37:48 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:38:13.549867 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi [None req-aac68b65-1e64-4049-ac1f-57695df75c3c admin admin] Calling method '>' {{(pid=110284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:13.551193 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: INFO nova.api.openstack.requestlog [None req-aac68b65-1e64-4049-ac1f-57695df75c3c admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001903 May 26 12:38:13.551585 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: [pid: 110284|app: 0|req: 19/36] 10.222.0.41 () {54 vars in 930 bytes} [Thu May 26 12:38:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:38:13.625052 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi [None req-e8df3b32-e989-4f13-8845-9f7dbd4bd8a0 admin admin] Calling method '>' {{(pid=110285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:13.644598 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: INFO nova.api.openstack.requestlog [None req-e8df3b32-e989-4f13-8845-9f7dbd4bd8a0 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.081702 May 26 12:38:13.653042 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: [pid: 110285|app: 0|req: 18/37] 10.222.0.41 () {60 vars in 1291 bytes} [Thu May 26 12:38:13 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:38:14.670040 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi [None req-aac68b65-1e64-4049-ac1f-57695df75c3c admin admin] Calling method '>' {{(pid=110284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:14.671210 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: INFO nova.api.openstack.requestlog [None req-aac68b65-1e64-4049-ac1f-57695df75c3c admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001528 May 26 12:38:14.671621 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: [pid: 110284|app: 0|req: 20/38] 10.222.0.41 () {56 vars in 1074 bytes} [Thu May 26 12:38:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:38:14.909071 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi [None req-971e4913-1ecb-450c-9aed-621c21bd43f7 admin admin] Calling method '>' {{(pid=110285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:14.919980 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: INFO nova.api.openstack.wsgi [None req-971e4913-1ecb-450c-9aed-621c21bd43f7 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 26 12:38:14.926731 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi [None req-971e4913-1ecb-450c-9aed-621c21bd43f7 admin admin] Request method failure captured: May 26 12:38:14.926731 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 26 12:38:14.926731 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: Accept: application/json May 26 12:38:14.926731 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: Accept-Encoding: gzip, deflate May 26 12:38:14.926731 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: Connection: keep-alive May 26 12:38:14.926731 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: Content-Length: 0 May 26 12:38:14.926731 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: Host: 10.222.0.41 May 26 12:38:14.926731 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: Openstack-Api-Version: compute 2.90 May 26 12:38:14.926731 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: Openstack-System-Scope: None May 26 12:38:14.926731 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: User-Agent: python-novaclient May 26 12:38:14.926731 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: X-Auth-Token: gAAAAABij3S2M8xKNizrVWf93m1GFDnKSLFjRmMOB1xnJ6xQUdS1HZ9l8WPWCa7V_eXz4W1lXlMXzX1udgEY8pmxy5VL7yPBclSmLVeCgSrTfOHwMcXozI_9QRQKOii1zuTl2hURHg3wMKMf_k4XHR585n3K4YJbiVxFTDC92xgKEIsSZINc40A May 26 12:38:14.926731 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: X-Domain-Id: None May 26 12:38:14.926731 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: X-Domain-Name: None May 26 12:38:14.926731 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: X-Identity-Status: Confirmed May 26 12:38:14.926731 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: X-Is-Admin-Project: True May 26 12:38:14.926731 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: X-Openstack-Nova-Api-Version: 2.90 May 26 12:38:14.926731 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: X-Project-Domain-Id: default May 26 12:38:14.926731 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: X-Project-Domain-Name: Default May 26 12:38:14.926731 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: X-Project-Id: 787f9c4d2f4e4a9fbcf0543d5d8232c5 May 26 12:38:14.926731 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: X-Project-Name: admin May 26 12:38:14.926731 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: X-Role: admin,member,reader May 26 12:38:14.926731 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: X-Roles: admin,member,reader May 26 12:38:14.928359 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/787f9c4d2f4e4a9fbcf0543d5d8232c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/787f9c4d2f4e4a9fbcf0543d5d8232c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/787f9c4d2f4e4a9fbcf0543d5d8232c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_787f9c4d2f4e4a9fbcf0543d5d8232c5", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 26 12:38:14.928359 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: X-Tenant: admin May 26 12:38:14.928359 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: X-Tenant-Id: 787f9c4d2f4e4a9fbcf0543d5d8232c5 May 26 12:38:14.928359 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: X-Tenant-Name: admin May 26 12:38:14.928359 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: X-User: admin May 26 12:38:14.928359 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: X-User-Domain-Id: default May 26 12:38:14.928359 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: X-User-Domain-Name: Default May 26 12:38:14.928359 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: X-User-Id: 46fa2a18bf5f49108e7df3a32506426e May 26 12:38:14.928359 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: X-User-Name: admin May 26 12:38:14.928359 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: method: > May 26 12:38:14.928359 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: exception: Flavor 42 could not be found. May 26 12:38:14.928359 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: action_args: {'id': '42'} May 26 12:38:14.928359 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: {{(pid=110285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:38:14.928359 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:38:14.929325 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 26 12:38:14.929325 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 26 12:38:14.929325 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 26 12:38:14.929325 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 26 12:38:14.929325 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 12:38:14.929325 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 12:38:14.929325 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 26 12:38:14.929325 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 26 12:38:14.929325 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 26 12:38:14.929325 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:38:14.929325 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 26 12:38:14.929325 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 26 12:38:14.929325 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 26 12:38:14.929325 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi May 26 12:38:14.929325 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:38:14.929325 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi May 26 12:38:14.929325 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:38:14.929325 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:38:14.929325 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:38:14.930531 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:38:14.930531 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:38:14.930531 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:38:14.930531 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:38:14.930531 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 26 12:38:14.930531 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 26 12:38:14.930531 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 26 12:38:14.930531 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi May 26 12:38:14.930531 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:38:14.930531 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi May 26 12:38:14.930531 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:38:14.930531 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:38:14.930531 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:38:14.930531 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:38:14.930531 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:38:14.930531 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 26 12:38:14.930531 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi May 26 12:38:14.930531 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi [None req-971e4913-1ecb-450c-9aed-621c21bd43f7 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110285) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:38:14.931858 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: INFO nova.api.openstack.requestlog [None req-971e4913-1ecb-450c-9aed-621c21bd43f7 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.080801 May 26 12:38:14.931858 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: [pid: 110285|app: 0|req: 19/39] 10.222.0.41 () {60 vars in 1190 bytes} [Thu May 26 12:38:14 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 26 12:38:14.939981 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi [None req-62886d9f-a3f5-42f4-b25b-00e958a1112d admin admin] Calling method '>' {{(pid=110284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:14.943049 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG dbcounter [-] [110284] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=110284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:14.966031 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: INFO nova.api.openstack.requestlog [None req-62886d9f-a3f5-42f4-b25b-00e958a1112d admin admin] 10.222.0.41 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.030104 May 26 12:38:14.966715 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: [pid: 110284|app: 0|req: 21/40] 10.222.0.41 () {60 vars in 1210 bytes} [Thu May 26 12:38:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:38:14.978095 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi [None req-7e4fb780-eae8-4bc8-835d-8e8f51f6a54d admin admin] Calling method '>' {{(pid=110285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:15.000737 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: INFO nova.api.openstack.requestlog [None req-7e4fb780-eae8-4bc8-835d-8e8f51f6a54d admin admin] 10.222.0.41 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026275 May 26 12:38:15.001876 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: [pid: 110285|app: 0|req: 20/41] 10.222.0.41 () {60 vars in 1210 bytes} [Thu May 26 12:38:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:38:15.011636 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi [None req-84d79160-e858-4ac3-85e3-5ded6d6805c4 admin admin] Calling method '>' {{(pid=110284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:15.018495 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: INFO nova.api.openstack.wsgi [None req-84d79160-e858-4ac3-85e3-5ded6d6805c4 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 26 12:38:15.022021 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi [None req-84d79160-e858-4ac3-85e3-5ded6d6805c4 admin admin] Request method failure captured: May 26 12:38:15.022021 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 26 12:38:15.022021 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: Accept: application/json May 26 12:38:15.022021 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: Accept-Encoding: gzip, deflate May 26 12:38:15.022021 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: Connection: keep-alive May 26 12:38:15.022021 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: Content-Length: 0 May 26 12:38:15.022021 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: Host: 10.222.0.41 May 26 12:38:15.022021 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: Openstack-Api-Version: compute 2.90 May 26 12:38:15.022021 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: Openstack-System-Scope: None May 26 12:38:15.022021 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: User-Agent: python-novaclient May 26 12:38:15.022021 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: X-Auth-Token: gAAAAABij3S2M8xKNizrVWf93m1GFDnKSLFjRmMOB1xnJ6xQUdS1HZ9l8WPWCa7V_eXz4W1lXlMXzX1udgEY8pmxy5VL7yPBclSmLVeCgSrTfOHwMcXozI_9QRQKOii1zuTl2hURHg3wMKMf_k4XHR585n3K4YJbiVxFTDC92xgKEIsSZINc40A May 26 12:38:15.022021 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: X-Domain-Id: None May 26 12:38:15.022021 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: X-Domain-Name: None May 26 12:38:15.022021 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: X-Identity-Status: Confirmed May 26 12:38:15.022021 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: X-Is-Admin-Project: True May 26 12:38:15.022021 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: X-Openstack-Nova-Api-Version: 2.90 May 26 12:38:15.022021 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: X-Project-Domain-Id: default May 26 12:38:15.022021 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: X-Project-Domain-Name: Default May 26 12:38:15.022021 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: X-Project-Id: 787f9c4d2f4e4a9fbcf0543d5d8232c5 May 26 12:38:15.022021 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: X-Project-Name: admin May 26 12:38:15.022021 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: X-Role: admin,member,reader May 26 12:38:15.022021 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: X-Roles: admin,member,reader May 26 12:38:15.023720 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/787f9c4d2f4e4a9fbcf0543d5d8232c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/787f9c4d2f4e4a9fbcf0543d5d8232c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/787f9c4d2f4e4a9fbcf0543d5d8232c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_787f9c4d2f4e4a9fbcf0543d5d8232c5", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 26 12:38:15.023720 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: X-Tenant: admin May 26 12:38:15.023720 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: X-Tenant-Id: 787f9c4d2f4e4a9fbcf0543d5d8232c5 May 26 12:38:15.023720 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: X-Tenant-Name: admin May 26 12:38:15.023720 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: X-User: admin May 26 12:38:15.023720 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: X-User-Domain-Id: default May 26 12:38:15.023720 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: X-User-Domain-Name: Default May 26 12:38:15.023720 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: X-User-Id: 46fa2a18bf5f49108e7df3a32506426e May 26 12:38:15.023720 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: X-User-Name: admin May 26 12:38:15.023720 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: method: > May 26 12:38:15.023720 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: exception: Flavor 42 could not be found. May 26 12:38:15.023720 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: action_args: {'id': '42'} May 26 12:38:15.023720 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: {{(pid=110284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:38:15.023720 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:38:15.025247 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 26 12:38:15.025247 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 26 12:38:15.025247 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 26 12:38:15.025247 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 26 12:38:15.025247 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 12:38:15.025247 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 12:38:15.025247 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 26 12:38:15.025247 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 26 12:38:15.025247 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 26 12:38:15.025247 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:38:15.025247 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 26 12:38:15.025247 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 26 12:38:15.025247 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 26 12:38:15.025247 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi May 26 12:38:15.025247 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:38:15.025247 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi May 26 12:38:15.025247 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:38:15.025247 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:38:15.025247 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:38:15.026966 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:38:15.026966 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:38:15.026966 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:38:15.026966 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:38:15.026966 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 26 12:38:15.026966 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 26 12:38:15.026966 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 26 12:38:15.026966 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi May 26 12:38:15.026966 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:38:15.026966 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi May 26 12:38:15.026966 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:38:15.026966 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:38:15.026966 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:38:15.026966 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:38:15.026966 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:38:15.026966 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 26 12:38:15.026966 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi May 26 12:38:15.026966 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi [None req-84d79160-e858-4ac3-85e3-5ded6d6805c4 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110284) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:38:15.028259 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: INFO nova.api.openstack.requestlog [None req-84d79160-e858-4ac3-85e3-5ded6d6805c4 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015503 May 26 12:38:15.028259 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: [pid: 110284|app: 0|req: 22/42] 10.222.0.41 () {60 vars in 1190 bytes} [Thu May 26 12:38:15 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 26 12:38:15.927275 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi [None req-7e4fb780-eae8-4bc8-835d-8e8f51f6a54d admin admin] Calling method '>' {{(pid=110285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:15.928316 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: INFO nova.api.openstack.requestlog [None req-7e4fb780-eae8-4bc8-835d-8e8f51f6a54d admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 May 26 12:38:15.928732 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: [pid: 110285|app: 0|req: 21/43] 10.222.0.41 () {56 vars in 1074 bytes} [Thu May 26 12:38:15 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:38:16.123262 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi [None req-ab89c6d5-f1cc-4b86-803d-5098039955c5 admin admin] Calling method '>' {{(pid=110284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:16.128239 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: INFO nova.api.openstack.wsgi [None req-ab89c6d5-f1cc-4b86-803d-5098039955c5 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 26 12:38:16.129848 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi [None req-ab89c6d5-f1cc-4b86-803d-5098039955c5 admin admin] Request method failure captured: May 26 12:38:16.129848 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 26 12:38:16.129848 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: Accept: application/json May 26 12:38:16.129848 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: Accept-Encoding: gzip, deflate May 26 12:38:16.129848 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: Connection: keep-alive May 26 12:38:16.129848 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: Content-Length: 0 May 26 12:38:16.129848 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: Host: 10.222.0.41 May 26 12:38:16.129848 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: Openstack-Api-Version: compute 2.90 May 26 12:38:16.129848 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: Openstack-System-Scope: None May 26 12:38:16.129848 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: User-Agent: python-novaclient May 26 12:38:16.129848 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: X-Auth-Token: gAAAAABij3S37BMPbmmshTzg6T1q5z87SGQMKKVW1oCNn3YxJIv6khjFhH5fuX73ngMLgsNTDgMBrCP35syVuJGxBrOAsHHwYBNVU7plgDLkotK_QwZTe6d7YgdfBQFNUf0x3kz5djEb74-iI0-4DAEBIEGjmI9Yxfv-5DW5inybbKan9Na4YfU May 26 12:38:16.129848 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: X-Domain-Id: None May 26 12:38:16.129848 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: X-Domain-Name: None May 26 12:38:16.129848 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: X-Identity-Status: Confirmed May 26 12:38:16.129848 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: X-Is-Admin-Project: True May 26 12:38:16.129848 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: X-Openstack-Nova-Api-Version: 2.90 May 26 12:38:16.129848 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: X-Project-Domain-Id: default May 26 12:38:16.129848 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: X-Project-Domain-Name: Default May 26 12:38:16.129848 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: X-Project-Id: 787f9c4d2f4e4a9fbcf0543d5d8232c5 May 26 12:38:16.129848 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: X-Project-Name: admin May 26 12:38:16.129848 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: X-Role: admin,member,reader May 26 12:38:16.129848 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: X-Roles: admin,member,reader May 26 12:38:16.131406 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/787f9c4d2f4e4a9fbcf0543d5d8232c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/787f9c4d2f4e4a9fbcf0543d5d8232c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/787f9c4d2f4e4a9fbcf0543d5d8232c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_787f9c4d2f4e4a9fbcf0543d5d8232c5", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 26 12:38:16.131406 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: X-Tenant: admin May 26 12:38:16.131406 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: X-Tenant-Id: 787f9c4d2f4e4a9fbcf0543d5d8232c5 May 26 12:38:16.131406 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: X-Tenant-Name: admin May 26 12:38:16.131406 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: X-User: admin May 26 12:38:16.131406 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: X-User-Domain-Id: default May 26 12:38:16.131406 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: X-User-Domain-Name: Default May 26 12:38:16.131406 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: X-User-Id: 46fa2a18bf5f49108e7df3a32506426e May 26 12:38:16.131406 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: X-User-Name: admin May 26 12:38:16.131406 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: method: > May 26 12:38:16.131406 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: exception: Flavor 84 could not be found. May 26 12:38:16.131406 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: action_args: {'id': '84'} May 26 12:38:16.131406 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: {{(pid=110284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:38:16.131406 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:38:16.132370 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 26 12:38:16.132370 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 26 12:38:16.132370 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 26 12:38:16.132370 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 26 12:38:16.132370 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 12:38:16.132370 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 12:38:16.132370 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 26 12:38:16.132370 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 26 12:38:16.132370 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 26 12:38:16.132370 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:38:16.132370 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 26 12:38:16.132370 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 26 12:38:16.132370 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 26 12:38:16.132370 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi May 26 12:38:16.132370 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:38:16.132370 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi May 26 12:38:16.132370 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:38:16.132370 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:38:16.132370 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:38:16.133696 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:38:16.133696 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:38:16.133696 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:38:16.133696 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:38:16.133696 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 26 12:38:16.133696 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 26 12:38:16.133696 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 26 12:38:16.133696 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi May 26 12:38:16.133696 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:38:16.133696 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi May 26 12:38:16.133696 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:38:16.133696 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:38:16.133696 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:38:16.133696 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:38:16.133696 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:38:16.133696 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 26 12:38:16.133696 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi May 26 12:38:16.133696 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi [None req-ab89c6d5-f1cc-4b86-803d-5098039955c5 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110284) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:38:16.134942 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: INFO nova.api.openstack.requestlog [None req-ab89c6d5-f1cc-4b86-803d-5098039955c5 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.064947 May 26 12:38:16.134942 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: [pid: 110284|app: 0|req: 23/44] 10.222.0.41 () {60 vars in 1190 bytes} [Thu May 26 12:38:16 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 26 12:38:16.144569 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi [None req-8f1ffe43-83e2-47b8-a013-d29b19e45d70 admin admin] Calling method '>' {{(pid=110285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:16.161059 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: INFO nova.api.openstack.requestlog [None req-8f1ffe43-83e2-47b8-a013-d29b19e45d70 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020498 May 26 12:38:16.161629 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: [pid: 110285|app: 0|req: 22/45] 10.222.0.41 () {60 vars in 1210 bytes} [Thu May 26 12:38:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:38:16.172990 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi [None req-7f3bb625-b462-42b6-ad6a-d97d684818df admin admin] Calling method '>' {{(pid=110284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:16.187437 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: INFO nova.api.openstack.requestlog [None req-7f3bb625-b462-42b6-ad6a-d97d684818df admin admin] 10.222.0.41 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018463 May 26 12:38:16.188002 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: [pid: 110284|app: 0|req: 24/46] 10.222.0.41 () {60 vars in 1210 bytes} [Thu May 26 12:38:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:38:16.197985 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi [None req-0b4b6604-0de4-4e66-afbf-d12a0d7b59c0 admin admin] Calling method '>' {{(pid=110285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:16.203689 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: INFO nova.api.openstack.wsgi [None req-0b4b6604-0de4-4e66-afbf-d12a0d7b59c0 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 26 12:38:16.205984 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi [None req-0b4b6604-0de4-4e66-afbf-d12a0d7b59c0 admin admin] Request method failure captured: May 26 12:38:16.205984 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 26 12:38:16.205984 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: Accept: application/json May 26 12:38:16.205984 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: Accept-Encoding: gzip, deflate May 26 12:38:16.205984 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: Connection: keep-alive May 26 12:38:16.205984 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: Content-Length: 0 May 26 12:38:16.205984 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: Host: 10.222.0.41 May 26 12:38:16.205984 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: Openstack-Api-Version: compute 2.90 May 26 12:38:16.205984 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: Openstack-System-Scope: None May 26 12:38:16.205984 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: User-Agent: python-novaclient May 26 12:38:16.205984 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: X-Auth-Token: gAAAAABij3S37BMPbmmshTzg6T1q5z87SGQMKKVW1oCNn3YxJIv6khjFhH5fuX73ngMLgsNTDgMBrCP35syVuJGxBrOAsHHwYBNVU7plgDLkotK_QwZTe6d7YgdfBQFNUf0x3kz5djEb74-iI0-4DAEBIEGjmI9Yxfv-5DW5inybbKan9Na4YfU May 26 12:38:16.205984 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: X-Domain-Id: None May 26 12:38:16.205984 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: X-Domain-Name: None May 26 12:38:16.205984 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: X-Identity-Status: Confirmed May 26 12:38:16.205984 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: X-Is-Admin-Project: True May 26 12:38:16.205984 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: X-Openstack-Nova-Api-Version: 2.90 May 26 12:38:16.205984 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: X-Project-Domain-Id: default May 26 12:38:16.205984 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: X-Project-Domain-Name: Default May 26 12:38:16.205984 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: X-Project-Id: 787f9c4d2f4e4a9fbcf0543d5d8232c5 May 26 12:38:16.205984 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: X-Project-Name: admin May 26 12:38:16.205984 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: X-Role: admin,member,reader May 26 12:38:16.205984 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: X-Roles: admin,member,reader May 26 12:38:16.207618 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/787f9c4d2f4e4a9fbcf0543d5d8232c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/787f9c4d2f4e4a9fbcf0543d5d8232c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/787f9c4d2f4e4a9fbcf0543d5d8232c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_787f9c4d2f4e4a9fbcf0543d5d8232c5", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 26 12:38:16.207618 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: X-Tenant: admin May 26 12:38:16.207618 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: X-Tenant-Id: 787f9c4d2f4e4a9fbcf0543d5d8232c5 May 26 12:38:16.207618 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: X-Tenant-Name: admin May 26 12:38:16.207618 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: X-User: admin May 26 12:38:16.207618 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: X-User-Domain-Id: default May 26 12:38:16.207618 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: X-User-Domain-Name: Default May 26 12:38:16.207618 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: X-User-Id: 46fa2a18bf5f49108e7df3a32506426e May 26 12:38:16.207618 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: X-User-Name: admin May 26 12:38:16.207618 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: method: > May 26 12:38:16.207618 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: exception: Flavor 84 could not be found. May 26 12:38:16.207618 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: action_args: {'id': '84'} May 26 12:38:16.207618 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: {{(pid=110285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:38:16.207618 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:38:16.208385 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 26 12:38:16.208385 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 26 12:38:16.208385 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 26 12:38:16.208385 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 26 12:38:16.208385 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 12:38:16.208385 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 12:38:16.208385 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 26 12:38:16.208385 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 26 12:38:16.208385 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 26 12:38:16.208385 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:38:16.208385 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 26 12:38:16.208385 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 26 12:38:16.208385 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 26 12:38:16.208385 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi May 26 12:38:16.208385 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:38:16.208385 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi May 26 12:38:16.208385 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:38:16.208385 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:38:16.208385 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:38:16.209415 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:38:16.209415 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:38:16.209415 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:38:16.209415 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:38:16.209415 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 26 12:38:16.209415 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 26 12:38:16.209415 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 26 12:38:16.209415 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi May 26 12:38:16.209415 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:38:16.209415 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi May 26 12:38:16.209415 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:38:16.209415 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:38:16.209415 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:38:16.209415 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:38:16.209415 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:38:16.209415 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 26 12:38:16.209415 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi May 26 12:38:16.209415 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi [None req-0b4b6604-0de4-4e66-afbf-d12a0d7b59c0 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110285) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:38:16.210446 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: INFO nova.api.openstack.requestlog [None req-0b4b6604-0de4-4e66-afbf-d12a0d7b59c0 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012848 May 26 12:38:16.210446 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: [pid: 110285|app: 0|req: 23/47] 10.222.0.41 () {60 vars in 1190 bytes} [Thu May 26 12:38:16 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 26 12:38:17.105513 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi [None req-7f3bb625-b462-42b6-ad6a-d97d684818df admin admin] Calling method '>' {{(pid=110284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:17.106546 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: INFO nova.api.openstack.requestlog [None req-7f3bb625-b462-42b6-ad6a-d97d684818df admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001521 May 26 12:38:17.106936 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: [pid: 110284|app: 0|req: 25/48] 10.222.0.41 () {56 vars in 1074 bytes} [Thu May 26 12:38:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:38:17.301287 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi [None req-1fdea382-a4a4-436e-999c-77e52ee52f22 admin admin] Calling method '>' {{(pid=110285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:17.307244 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: INFO nova.api.openstack.wsgi [None req-1fdea382-a4a4-436e-999c-77e52ee52f22 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 26 12:38:17.308759 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi [None req-1fdea382-a4a4-436e-999c-77e52ee52f22 admin admin] Request method failure captured: May 26 12:38:17.308759 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 26 12:38:17.308759 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: Accept: application/json May 26 12:38:17.308759 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: Accept-Encoding: gzip, deflate May 26 12:38:17.308759 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: Connection: keep-alive May 26 12:38:17.308759 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: Content-Length: 0 May 26 12:38:17.308759 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: Host: 10.222.0.41 May 26 12:38:17.308759 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: Openstack-Api-Version: compute 2.90 May 26 12:38:17.308759 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: Openstack-System-Scope: None May 26 12:38:17.308759 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: User-Agent: python-novaclient May 26 12:38:17.308759 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: X-Auth-Token: gAAAAABij3S5woyCJo1xL71yPt2Qx1V5sE1h9NgsFrHvB-vLEZlVuXiiRxULA7GFMy85XeM1yF5TRyrpK3E6wDmwA2lrvgpxh8EPRr_GqwViRBgShH0Vy3mqp--9Ly9v1lWoa-GSC4IB6teEMUlw7BibTj_S-pB6rlCTsz7Nmy49dI0tg0SUDOQ May 26 12:38:17.308759 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: X-Domain-Id: None May 26 12:38:17.308759 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: X-Domain-Name: None May 26 12:38:17.308759 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: X-Identity-Status: Confirmed May 26 12:38:17.308759 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: X-Is-Admin-Project: True May 26 12:38:17.308759 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: X-Openstack-Nova-Api-Version: 2.90 May 26 12:38:17.308759 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: X-Project-Domain-Id: default May 26 12:38:17.308759 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: X-Project-Domain-Name: Default May 26 12:38:17.308759 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: X-Project-Id: 787f9c4d2f4e4a9fbcf0543d5d8232c5 May 26 12:38:17.308759 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: X-Project-Name: admin May 26 12:38:17.308759 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: X-Role: admin,member,reader May 26 12:38:17.308759 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: X-Roles: admin,member,reader May 26 12:38:17.310208 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/787f9c4d2f4e4a9fbcf0543d5d8232c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/787f9c4d2f4e4a9fbcf0543d5d8232c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/787f9c4d2f4e4a9fbcf0543d5d8232c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_787f9c4d2f4e4a9fbcf0543d5d8232c5", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 26 12:38:17.310208 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: X-Tenant: admin May 26 12:38:17.310208 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: X-Tenant-Id: 787f9c4d2f4e4a9fbcf0543d5d8232c5 May 26 12:38:17.310208 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: X-Tenant-Name: admin May 26 12:38:17.310208 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: X-User: admin May 26 12:38:17.310208 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: X-User-Domain-Id: default May 26 12:38:17.310208 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: X-User-Domain-Name: Default May 26 12:38:17.310208 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: X-User-Id: 46fa2a18bf5f49108e7df3a32506426e May 26 12:38:17.310208 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: X-User-Name: admin May 26 12:38:17.310208 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: method: > May 26 12:38:17.310208 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: exception: Flavor 451 could not be found. May 26 12:38:17.310208 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: action_args: {'id': '451'} May 26 12:38:17.310208 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: {{(pid=110285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:38:17.310208 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:38:17.311239 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 26 12:38:17.311239 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 26 12:38:17.311239 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 26 12:38:17.311239 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 26 12:38:17.311239 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 12:38:17.311239 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 12:38:17.311239 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 26 12:38:17.311239 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 26 12:38:17.311239 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 26 12:38:17.311239 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:38:17.311239 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 26 12:38:17.311239 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 26 12:38:17.311239 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 26 12:38:17.311239 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi May 26 12:38:17.311239 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:38:17.311239 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi May 26 12:38:17.311239 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:38:17.311239 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:38:17.311239 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:38:17.312751 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:38:17.312751 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:38:17.312751 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:38:17.312751 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:38:17.312751 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 26 12:38:17.312751 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 26 12:38:17.312751 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 26 12:38:17.312751 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi May 26 12:38:17.312751 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:38:17.312751 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi May 26 12:38:17.312751 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:38:17.312751 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:38:17.312751 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:38:17.312751 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:38:17.312751 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:38:17.312751 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 26 12:38:17.312751 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: ERROR nova.api.openstack.wsgi May 26 12:38:17.312751 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi [None req-1fdea382-a4a4-436e-999c-77e52ee52f22 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110285) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:38:17.314025 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: INFO nova.api.openstack.requestlog [None req-1fdea382-a4a4-436e-999c-77e52ee52f22 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.063864 May 26 12:38:17.314025 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: [pid: 110285|app: 0|req: 24/49] 10.222.0.41 () {60 vars in 1193 bytes} [Thu May 26 12:38:17 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 26 12:38:17.321078 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi [None req-d89b3699-71c8-4846-953b-da5017c6295f admin admin] Calling method '>' {{(pid=110284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:17.335439 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: INFO nova.api.openstack.requestlog [None req-d89b3699-71c8-4846-953b-da5017c6295f admin admin] 10.222.0.41 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018019 May 26 12:38:17.335983 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: [pid: 110284|app: 0|req: 26/50] 10.222.0.41 () {60 vars in 1210 bytes} [Thu May 26 12:38:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:38:17.346951 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi [None req-9d97369a-16bc-4d22-a2c3-d4a9cc6c53a2 admin admin] Calling method '>' {{(pid=110285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:17.361501 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: INFO nova.api.openstack.requestlog [None req-9d97369a-16bc-4d22-a2c3-d4a9cc6c53a2 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018090 May 26 12:38:17.362083 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: [pid: 110285|app: 0|req: 25/51] 10.222.0.41 () {60 vars in 1210 bytes} [Thu May 26 12:38:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:38:17.371954 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi [None req-57b287c0-ab01-405b-96ce-ac36c257434c admin admin] Calling method '>' {{(pid=110284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:17.377441 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: INFO nova.api.openstack.wsgi [None req-57b287c0-ab01-405b-96ce-ac36c257434c admin admin] HTTP exception thrown: Flavor 451 could not be found. May 26 12:38:17.378977 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi [None req-57b287c0-ab01-405b-96ce-ac36c257434c admin admin] Request method failure captured: May 26 12:38:17.378977 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 26 12:38:17.378977 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: Accept: application/json May 26 12:38:17.378977 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: Accept-Encoding: gzip, deflate May 26 12:38:17.378977 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: Connection: keep-alive May 26 12:38:17.378977 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: Content-Length: 0 May 26 12:38:17.378977 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: Host: 10.222.0.41 May 26 12:38:17.378977 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: Openstack-Api-Version: compute 2.90 May 26 12:38:17.378977 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: Openstack-System-Scope: None May 26 12:38:17.378977 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: User-Agent: python-novaclient May 26 12:38:17.378977 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: X-Auth-Token: gAAAAABij3S5woyCJo1xL71yPt2Qx1V5sE1h9NgsFrHvB-vLEZlVuXiiRxULA7GFMy85XeM1yF5TRyrpK3E6wDmwA2lrvgpxh8EPRr_GqwViRBgShH0Vy3mqp--9Ly9v1lWoa-GSC4IB6teEMUlw7BibTj_S-pB6rlCTsz7Nmy49dI0tg0SUDOQ May 26 12:38:17.378977 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: X-Domain-Id: None May 26 12:38:17.378977 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: X-Domain-Name: None May 26 12:38:17.378977 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: X-Identity-Status: Confirmed May 26 12:38:17.378977 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: X-Is-Admin-Project: True May 26 12:38:17.378977 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: X-Openstack-Nova-Api-Version: 2.90 May 26 12:38:17.378977 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: X-Project-Domain-Id: default May 26 12:38:17.378977 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: X-Project-Domain-Name: Default May 26 12:38:17.378977 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: X-Project-Id: 787f9c4d2f4e4a9fbcf0543d5d8232c5 May 26 12:38:17.378977 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: X-Project-Name: admin May 26 12:38:17.378977 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: X-Role: admin,member,reader May 26 12:38:17.378977 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: X-Roles: admin,member,reader May 26 12:38:17.380857 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/787f9c4d2f4e4a9fbcf0543d5d8232c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/787f9c4d2f4e4a9fbcf0543d5d8232c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/787f9c4d2f4e4a9fbcf0543d5d8232c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_787f9c4d2f4e4a9fbcf0543d5d8232c5", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 26 12:38:17.380857 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: X-Tenant: admin May 26 12:38:17.380857 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: X-Tenant-Id: 787f9c4d2f4e4a9fbcf0543d5d8232c5 May 26 12:38:17.380857 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: X-Tenant-Name: admin May 26 12:38:17.380857 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: X-User: admin May 26 12:38:17.380857 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: X-User-Domain-Id: default May 26 12:38:17.380857 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: X-User-Domain-Name: Default May 26 12:38:17.380857 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: X-User-Id: 46fa2a18bf5f49108e7df3a32506426e May 26 12:38:17.380857 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: X-User-Name: admin May 26 12:38:17.380857 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: method: > May 26 12:38:17.380857 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: exception: Flavor 451 could not be found. May 26 12:38:17.380857 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: action_args: {'id': '451'} May 26 12:38:17.380857 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: {{(pid=110284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:38:17.380857 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:38:17.381992 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 26 12:38:17.381992 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 26 12:38:17.381992 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 26 12:38:17.381992 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 26 12:38:17.381992 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 12:38:17.381992 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 12:38:17.381992 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 26 12:38:17.381992 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 26 12:38:17.381992 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 26 12:38:17.381992 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:38:17.381992 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 26 12:38:17.381992 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 26 12:38:17.381992 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 26 12:38:17.381992 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi May 26 12:38:17.381992 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:38:17.381992 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi May 26 12:38:17.381992 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:38:17.381992 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:38:17.381992 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:38:17.383589 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:38:17.383589 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:38:17.383589 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:38:17.383589 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:38:17.383589 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 26 12:38:17.383589 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 26 12:38:17.383589 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 26 12:38:17.383589 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi May 26 12:38:17.383589 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:38:17.383589 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi May 26 12:38:17.383589 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:38:17.383589 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:38:17.383589 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:38:17.383589 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:38:17.383589 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:38:17.383589 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 26 12:38:17.383589 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi May 26 12:38:17.383589 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi [None req-57b287c0-ab01-405b-96ce-ac36c257434c admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110284) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:38:17.384830 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: INFO nova.api.openstack.requestlog [None req-57b287c0-ab01-405b-96ce-ac36c257434c admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011982 May 26 12:38:17.384830 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: [pid: 110284|app: 0|req: 27/52] 10.222.0.41 () {60 vars in 1193 bytes} [Thu May 26 12:38:17 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 26 12:38:18.281948 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi [None req-9d97369a-16bc-4d22-a2c3-d4a9cc6c53a2 admin admin] Calling method '>' {{(pid=110285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:18.283625 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: INFO nova.api.openstack.requestlog [None req-9d97369a-16bc-4d22-a2c3-d4a9cc6c53a2 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002137 May 26 12:38:18.284027 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: [pid: 110285|app: 0|req: 26/53] 10.222.0.41 () {56 vars in 1074 bytes} [Thu May 26 12:38:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:38:18.477436 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi [None req-17f3adc6-b6be-4080-9d38-fb3e0d6cdd7d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:38:18.589894 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: INFO nova.api.openstack.requestlog [None req-17f3adc6-b6be-4080-9d38-fb3e0d6cdd7d admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.166068 May 26 12:38:18.590436 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: [pid: 110284|app: 0|req: 28/54] 10.222.0.41 () {64 vars in 1235 bytes} [Thu May 26 12:38:18 2022] POST /compute/v2.1/flavors => generated 404 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 12:38:19.480576 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi [None req-9d97369a-16bc-4d22-a2c3-d4a9cc6c53a2 admin admin] Calling method '>' {{(pid=110285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:19.481603 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: INFO nova.api.openstack.requestlog [None req-9d97369a-16bc-4d22-a2c3-d4a9cc6c53a2 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 May 26 12:38:19.482026 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: [pid: 110285|app: 0|req: 27/55] 10.222.0.41 () {56 vars in 1074 bytes} [Thu May 26 12:38:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:38:19.686387 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi [None req-a0ef5cad-d6ab-4e57-bb7e-05de34dd5129 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:38:19.835622 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: INFO nova.api.openstack.requestlog [None req-a0ef5cad-d6ab-4e57-bb7e-05de34dd5129 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.210355 May 26 12:38:19.836082 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: [pid: 110284|app: 0|req: 29/56] 10.222.0.41 () {64 vars in 1235 bytes} [Thu May 26 12:38:19 2022] POST /compute/v2.1/flavors => generated 405 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 12:38:20.712882 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi [None req-9d97369a-16bc-4d22-a2c3-d4a9cc6c53a2 admin admin] Calling method '>' {{(pid=110285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:20.713926 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: INFO nova.api.openstack.requestlog [None req-9d97369a-16bc-4d22-a2c3-d4a9cc6c53a2 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 May 26 12:38:20.714367 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: [pid: 110285|app: 0|req: 28/57] 10.222.0.41 () {56 vars in 1074 bytes} [Thu May 26 12:38:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:38:20.905067 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi [None req-46dd7e57-58de-47a0-80b9-79b79b09f0eb admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:38:21.090636 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: INFO nova.api.openstack.requestlog [None req-46dd7e57-58de-47a0-80b9-79b79b09f0eb admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.239206 May 26 12:38:21.091200 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: [pid: 110284|app: 0|req: 30/58] 10.222.0.41 () {64 vars in 1235 bytes} [Thu May 26 12:38:20 2022] POST /compute/v2.1/flavors => generated 407 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 12:38:21.974525 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi [None req-9d97369a-16bc-4d22-a2c3-d4a9cc6c53a2 admin admin] Calling method '>' {{(pid=110285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:21.975595 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: INFO nova.api.openstack.requestlog [None req-9d97369a-16bc-4d22-a2c3-d4a9cc6c53a2 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001575 May 26 12:38:21.976002 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: [pid: 110285|app: 0|req: 29/59] 10.222.0.41 () {56 vars in 1074 bytes} [Thu May 26 12:38:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:38:22.168585 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi [None req-f00a415d-4444-40a0-af41-956f7524e438 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:38:22.360729 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: INFO nova.api.openstack.requestlog [None req-f00a415d-4444-40a0-af41-956f7524e438 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.247084 May 26 12:38:22.361270 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: [pid: 110284|app: 0|req: 31/60] 10.222.0.41 () {64 vars in 1235 bytes} [Thu May 26 12:38:22 2022] POST /compute/v2.1/flavors => generated 409 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 12:38:23.256014 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi [None req-9d97369a-16bc-4d22-a2c3-d4a9cc6c53a2 admin admin] Calling method '>' {{(pid=110285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:23.257018 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: INFO nova.api.openstack.requestlog [None req-9d97369a-16bc-4d22-a2c3-d4a9cc6c53a2 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 May 26 12:38:23.257421 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: [pid: 110285|app: 0|req: 30/61] 10.222.0.41 () {56 vars in 1074 bytes} [Thu May 26 12:38:23 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:38:23.450514 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi [None req-50f3ce2e-3a45-48d5-856d-ddff5f22999e admin admin] Calling method '>' {{(pid=110284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:38:23.470953 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: INFO nova.api.openstack.requestlog [None req-50f3ce2e-3a45-48d5-856d-ddff5f22999e admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.075843 May 26 12:38:23.471501 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: [pid: 110284|app: 0|req: 32/62] 10.222.0.41 () {60 vars in 1202 bytes} [Thu May 26 12:38:23 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:39:27.665371 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi [None req-9d97369a-16bc-4d22-a2c3-d4a9cc6c53a2 admin admin] Calling method '>' {{(pid=110285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:27.666412 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: INFO nova.api.openstack.requestlog [None req-9d97369a-16bc-4d22-a2c3-d4a9cc6c53a2 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 May 26 12:39:27.666826 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: [pid: 110285|app: 0|req: 31/63] 10.222.0.41 () {54 vars in 930 bytes} [Thu May 26 12:39:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:39:27.674701 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG dbcounter [-] [110284] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=110284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:27.737343 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi [None req-e7beb08a-8ab0-4798-b9f5-7ed91b9433af admin admin] Calling method '>' {{(pid=110284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:27.757227 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: INFO nova.api.openstack.requestlog [None req-e7beb08a-8ab0-4798-b9f5-7ed91b9433af admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.083845 May 26 12:39:27.757820 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: [pid: 110284|app: 0|req: 33/64] 10.222.0.41 () {60 vars in 1291 bytes} [Thu May 26 12:39:27 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:39:27.779345 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG dbcounter [-] [110285] Writing DB stats nova_api:SELECT=19,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=110285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:27.783589 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi [None req-d825e77f-6ea3-4c29-9a04-d9eed40328d1 admin admin] Calling method '>' {{(pid=110285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:27.792364 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: INFO nova.api.openstack.requestlog [None req-d825e77f-6ea3-4c29-9a04-d9eed40328d1 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014599 May 26 12:39:27.793036 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: [pid: 110285|app: 0|req: 32/65] 10.222.0.41 () {60 vars in 1282 bytes} [Thu May 26 12:39:27 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:39:27.805523 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi [None req-d90fcba8-5fdb-4382-a13a-d02195d92108 admin admin] Calling method '>' {{(pid=110284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:27.814294 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: INFO nova.api.openstack.requestlog [None req-d90fcba8-5fdb-4382-a13a-d02195d92108 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012696 May 26 12:39:27.814859 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: [pid: 110284|app: 0|req: 34/66] 10.222.0.41 () {60 vars in 1285 bytes} [Thu May 26 12:39:27 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:39:27.827264 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi [None req-eaaaa1be-63e8-4bd6-88da-73435f429bc1 admin admin] Calling method '>' {{(pid=110285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:27.835719 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: INFO nova.api.openstack.requestlog [None req-eaaaa1be-63e8-4bd6-88da-73435f429bc1 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012711 May 26 12:39:27.836258 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: [pid: 110285|app: 0|req: 33/67] 10.222.0.41 () {60 vars in 1285 bytes} [Thu May 26 12:39:27 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:39:27.849588 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi [None req-0fc3b968-e072-4a84-9951-f0a117f9e0b9 admin admin] Calling method '>' {{(pid=110284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:39:27.857813 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: INFO nova.api.openstack.requestlog [None req-0fc3b968-e072-4a84-9951-f0a117f9e0b9 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011977 May 26 12:39:27.858361 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: [pid: 110284|app: 0|req: 35/68] 10.222.0.41 () {60 vars in 1282 bytes} [Thu May 26 12:39:27 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:43:55.934217 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi [None req-eaaaa1be-63e8-4bd6-88da-73435f429bc1 admin admin] Calling method '>' {{(pid=110285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:55.940879 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: INFO nova.api.openstack.requestlog [None req-eaaaa1be-63e8-4bd6-88da-73435f429bc1 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001521 May 26 12:43:55.940879 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: [pid: 110285|app: 0|req: 34/69] 10.222.0.41 () {56 vars in 1074 bytes} [Thu May 26 12:43:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:43:56.097222 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG dbcounter [-] [110284] Writing DB stats nova_api:SELECT=6 {{(pid=110284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:43:56.227956 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi [None req-69a61a13-9e1b-4ffd-a8d1-ce2bca7f1aab admin admin] Calling method '>' {{(pid=110284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:56.229120 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 12:43:56.229120 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: warnings.warn(msg) May 26 12:43:56.230390 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG oslo_concurrency.lockutils [None req-69a61a13-9e1b-4ffd-a8d1-ce2bca7f1aab admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:56.230953 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG oslo_concurrency.lockutils [None req-69a61a13-9e1b-4ffd-a8d1-ce2bca7f1aab admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:56.231766 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG oslo_concurrency.lockutils [None req-69a61a13-9e1b-4ffd-a8d1-ce2bca7f1aab admin admin] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:56.232198 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG oslo_concurrency.lockutils [None req-69a61a13-9e1b-4ffd-a8d1-ce2bca7f1aab admin admin] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:56.266516 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: INFO nova.api.openstack.requestlog [None req-69a61a13-9e1b-4ffd-a8d1-ce2bca7f1aab admin admin] 10.222.0.41 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.170895 May 26 12:43:56.267074 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: [pid: 110284|app: 0|req: 36/70] 10.222.0.41 () {60 vars in 1193 bytes} [Thu May 26 12:43:56 2022] GET /compute/v2.1/os-services => generated 791 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 12:43:57.160875 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi [None req-eaaaa1be-63e8-4bd6-88da-73435f429bc1 admin admin] Calling method '>' {{(pid=110285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:57.161941 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: INFO nova.api.openstack.requestlog [None req-eaaaa1be-63e8-4bd6-88da-73435f429bc1 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 May 26 12:43:57.162332 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: [pid: 110285|app: 0|req: 35/71] 10.222.0.41 () {56 vars in 1074 bytes} [Thu May 26 12:43:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:43:57.354539 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi [None req-e2ab340c-94ca-4485-a802-6310b188d3e0 admin admin] Calling method '>' {{(pid=110284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:43:57.355732 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 12:43:57.355732 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: warnings.warn(msg) May 26 12:43:57.356898 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG oslo_concurrency.lockutils [None req-e2ab340c-94ca-4485-a802-6310b188d3e0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:57.357335 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG oslo_concurrency.lockutils [None req-e2ab340c-94ca-4485-a802-6310b188d3e0 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:57.358130 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG oslo_concurrency.lockutils [None req-e2ab340c-94ca-4485-a802-6310b188d3e0 admin admin] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:43:57.358581 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG oslo_concurrency.lockutils [None req-e2ab340c-94ca-4485-a802-6310b188d3e0 admin admin] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:43:57.378168 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: INFO nova.api.openstack.requestlog [None req-e2ab340c-94ca-4485-a802-6310b188d3e0 admin admin] 10.222.0.41 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.076846 May 26 12:43:57.378709 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: [pid: 110284|app: 0|req: 37/72] 10.222.0.41 () {60 vars in 1193 bytes} [Thu May 26 12:43:57 2022] GET /compute/v2.1/os-services => generated 791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 12:44:08.706147 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi [None req-eaaaa1be-63e8-4bd6-88da-73435f429bc1 admin admin] Calling method '>' {{(pid=110285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:08.707150 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: INFO nova.api.openstack.requestlog [None req-eaaaa1be-63e8-4bd6-88da-73435f429bc1 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001522 May 26 12:44:08.707782 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: [pid: 110285|app: 0|req: 36/73] 10.222.0.41 () {56 vars in 1074 bytes} [Thu May 26 12:44:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:44:08.852668 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG dbcounter [-] [110284] Writing DB stats nova_cell0:SELECT=4 {{(pid=110284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:08.853392 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG dbcounter [-] [110284] Writing DB stats nova_cell1:SELECT=4 {{(pid=110284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:08.854046 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG dbcounter [-] [110284] Writing DB stats nova_api:SELECT=8 {{(pid=110284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:08.906240 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi [None req-b4cfecba-d050-4166-91d0-43a75b2d227d admin admin] Calling method '>' {{(pid=110284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:08.907434 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 12:44:08.907434 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: warnings.warn(msg) May 26 12:44:08.908659 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG oslo_concurrency.lockutils [None req-b4cfecba-d050-4166-91d0-43a75b2d227d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:08.909093 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG oslo_concurrency.lockutils [None req-b4cfecba-d050-4166-91d0-43a75b2d227d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:08.909908 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG oslo_concurrency.lockutils [None req-b4cfecba-d050-4166-91d0-43a75b2d227d admin admin] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:08.910336 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG oslo_concurrency.lockutils [None req-b4cfecba-d050-4166-91d0-43a75b2d227d admin admin] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:08.937528 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: INFO nova.api.openstack.requestlog [None req-b4cfecba-d050-4166-91d0-43a75b2d227d admin admin] 10.222.0.41 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.089847 May 26 12:44:08.938045 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: [pid: 110284|app: 0|req: 38/74] 10.222.0.41 () {60 vars in 1193 bytes} [Thu May 26 12:44:08 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:44:09.851123 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: DEBUG nova.api.openstack.wsgi [None req-eaaaa1be-63e8-4bd6-88da-73435f429bc1 admin admin] Calling method '>' {{(pid=110285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:09.852409 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: INFO nova.api.openstack.requestlog [None req-eaaaa1be-63e8-4bd6-88da-73435f429bc1 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001809 May 26 12:44:09.852812 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: [pid: 110285|app: 0|req: 37/75] 10.222.0.41 () {56 vars in 1074 bytes} [Thu May 26 12:44:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:44:10.048342 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi [None req-cf38d899-e975-4af9-87c0-aa4594d7b334 admin admin] Calling method '>' {{(pid=110284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:44:10.049872 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 12:44:10.049872 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: warnings.warn(msg) May 26 12:44:10.051285 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG oslo_concurrency.lockutils [None req-cf38d899-e975-4af9-87c0-aa4594d7b334 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:10.051823 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG oslo_concurrency.lockutils [None req-cf38d899-e975-4af9-87c0-aa4594d7b334 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:10.052726 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG oslo_concurrency.lockutils [None req-cf38d899-e975-4af9-87c0-aa4594d7b334 admin admin] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:44:10.053251 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: DEBUG oslo_concurrency.lockutils [None req-cf38d899-e975-4af9-87c0-aa4594d7b334 admin admin] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:44:10.076790 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: INFO nova.api.openstack.requestlog [None req-cf38d899-e975-4af9-87c0-aa4594d7b334 admin admin] 10.222.0.41 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.082112 May 26 12:44:10.077562 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: [pid: 110284|app: 0|req: 39/76] 10.222.0.41 () {60 vars in 1193 bytes} [Thu May 26 12:44:09 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:45:08.658759 dv-cinder-815712-9-iscsi devstack@n-api.service[110283]: Thu May 26 12:45:08 2022 - graceful shutdown triggered... May 26 12:45:08.658912 dv-cinder-815712-9-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 26 12:45:08.659926 dv-cinder-815712-9-iscsi devstack@n-api.service[110285]: Gracefully killing worker 2 (pid: 110285)... May 26 12:45:08.660308 dv-cinder-815712-9-iscsi devstack@n-api.service[110284]: Gracefully killing worker 1 (pid: 110284)... May 26 12:45:09.661025 dv-cinder-815712-9-iscsi devstack@n-api.service[110283]: worker 1 buried after 1 seconds May 26 12:45:09.661025 dv-cinder-815712-9-iscsi devstack@n-api.service[110283]: worker 2 buried after 1 seconds May 26 12:45:09.661025 dv-cinder-815712-9-iscsi devstack@n-api.service[110283]: goodbye to uWSGI. May 26 12:45:09.662602 dv-cinder-815712-9-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 26 12:45:09.663422 dv-cinder-815712-9-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 26 12:45:09.666429 dv-cinder-815712-9-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 26 12:45:09.681109 dv-cinder-815712-9-iscsi devstack@n-api.service[124807]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 26 12:45:09.697598 dv-cinder-815712-9-iscsi devstack@n-api.service[124807]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 26 12:45:09 2022] *** May 26 12:45:09.698200 dv-cinder-815712-9-iscsi devstack@n-api.service[124807]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 26 12:45:09.698382 dv-cinder-815712-9-iscsi devstack@n-api.service[124807]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 26 12:45:09.698539 dv-cinder-815712-9-iscsi devstack@n-api.service[124807]: nodename: dv-cinder-815712-9-iscsi May 26 12:45:09.698686 dv-cinder-815712-9-iscsi devstack@n-api.service[124807]: machine: x86_64 May 26 12:45:09.698834 dv-cinder-815712-9-iscsi devstack@n-api.service[124807]: clock source: unix May 26 12:45:09.700278 dv-cinder-815712-9-iscsi devstack@n-api.service[124807]: pcre jit disabled May 26 12:45:09.700452 dv-cinder-815712-9-iscsi devstack@n-api.service[124807]: detected number of CPU cores: 4 May 26 12:45:09.700607 dv-cinder-815712-9-iscsi devstack@n-api.service[124807]: current working directory: / May 26 12:45:09.700751 dv-cinder-815712-9-iscsi devstack@n-api.service[124807]: detected binary path: /usr/bin/uwsgi-core May 26 12:45:09.700908 dv-cinder-815712-9-iscsi devstack@n-api.service[124807]: your processes number limit is 47680 May 26 12:45:09.701050 dv-cinder-815712-9-iscsi devstack@n-api.service[124807]: your memory page size is 4096 bytes May 26 12:45:09.701192 dv-cinder-815712-9-iscsi devstack@n-api.service[124807]: detected max file descriptor number: 2048 May 26 12:45:09.701335 dv-cinder-815712-9-iscsi devstack@n-api.service[124807]: lock engine: pthread robust mutexes May 26 12:45:09.701651 dv-cinder-815712-9-iscsi devstack@n-api.service[124807]: thunder lock: enabled May 26 12:45:09.702133 dv-cinder-815712-9-iscsi devstack@n-api.service[124807]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 26 12:45:09.702392 dv-cinder-815712-9-iscsi devstack@n-api.service[124807]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 26 12:45:09.748595 dv-cinder-815712-9-iscsi devstack@n-api.service[124807]: Python main interpreter initialized at 0x562d877ed9c0 May 26 12:45:09.748595 dv-cinder-815712-9-iscsi devstack@n-api.service[124807]: python threads support enabled May 26 12:45:09.748595 dv-cinder-815712-9-iscsi devstack@n-api.service[124807]: your server socket listen backlog is limited to 100 connections May 26 12:45:09.748595 dv-cinder-815712-9-iscsi devstack@n-api.service[124807]: your mercy for graceful operations on workers is 90 seconds May 26 12:45:09.749031 dv-cinder-815712-9-iscsi devstack@n-api.service[124807]: mapped 403077 bytes (393 KB) for 2 cores May 26 12:45:09.749031 dv-cinder-815712-9-iscsi devstack@n-api.service[124807]: *** Operational MODE: preforking *** May 26 12:45:09.749272 dv-cinder-815712-9-iscsi devstack@n-api.service[124807]: *** uWSGI is running in multiple interpreter mode *** May 26 12:45:09.749272 dv-cinder-815712-9-iscsi devstack@n-api.service[124807]: spawned uWSGI master process (pid: 124807) May 26 12:45:09.749538 dv-cinder-815712-9-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 26 12:45:09.750715 dv-cinder-815712-9-iscsi devstack@n-api.service[124807]: spawned uWSGI worker 1 (pid: 124823, cores: 1) May 26 12:45:09.750715 dv-cinder-815712-9-iscsi devstack@n-api.service[124807]: spawned uWSGI worker 2 (pid: 124824, cores: 1) May 26 12:45:09.750715 dv-cinder-815712-9-iscsi devstack@n-api.service[124807]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 26 12:45:10.951064 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 26 12:45:10.967910 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 26 12:45:11.760895 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 12:45:11.760895 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: from cryptography.utils import int_from_bytes May 26 12:45:11.761221 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 12:45:11.761221 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: from cryptography.utils import int_from_bytes May 26 12:45:11.770107 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 12:45:11.770107 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: from cryptography.utils import int_from_bytes May 26 12:45:11.770456 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 12:45:11.770456 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: from cryptography.utils import int_from_bytes May 26 12:45:14.180434 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 12:45:14.181564 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 12:45:14.181820 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 12:45:14.182195 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 12:45:14.182456 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 12:45:14.182850 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.183181 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.183507 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.183832 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.184167 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.184486 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.184816 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.185142 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.185470 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.185760 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.186084 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.186417 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815712-9-iscsi {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.186745 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.187059 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.187372 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.187702 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.188009 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.188336 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.188649 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.189155 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.189611 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.189949 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.190263 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.190605 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.190926 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.191239 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.191562 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.191895 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.192210 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.192555 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.192941 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815712-9-iscsi {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.193260 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.193580 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.193926 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.194350 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.194666 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.194980 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.195307 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.195635 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.196069 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.196313 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.196615 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.196937 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.200963 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.200963 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.200963 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.200963 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.200963 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.200963 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.200963 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.200963 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.202172 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.202172 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.202172 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.202172 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.202172 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.202172 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.202172 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.202816 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.202816 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.202816 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.202816 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.203126 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.203126 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.203507 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.203748 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.204057 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.204380 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.204698 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.205025 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.205336 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.205658 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.206105 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.41 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.206360 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.41 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.206686 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.207103 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.207324 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.207669 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.207951 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.208276 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.208587 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.208936 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.209204 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.209524 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.209876 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.210181 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.210434 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.210740 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.211045 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.211366 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.211671 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.211977 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.212819 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.213120 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.213429 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.213759 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.214069 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.214374 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.214681 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.214986 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.215291 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.215596 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.215902 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.216221 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.216541 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.216848 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.217154 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.217460 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.217789 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.218119 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.218427 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.218733 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.219057 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.219363 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.219667 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.219988 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.220295 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.220601 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.220923 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.221225 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.221531 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.221875 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.222186 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.222493 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.222803 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.223103 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.223407 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.223711 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.224014 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.224320 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.224622 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.224941 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.225263 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.225572 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.225912 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.226475 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.226796 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.227139 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.227475 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.228376 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.228696 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.229028 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.229367 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.229708 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.230029 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.230347 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.230676 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.230989 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.231303 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.231613 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.231934 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.232253 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.232588 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.232905 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.233223 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.233545 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.233892 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.234215 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.234545 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.234875 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.235191 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.235537 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.235888 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.236212 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.236538 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.236868 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.237184 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.237497 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.237832 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.238162 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.238506 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.238820 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.239141 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.239456 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.239771 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.240090 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.240400 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.240714 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.241056 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.241373 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.241707 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.242034 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.242397 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.242661 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.242974 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.243283 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.243643 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.243927 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.244239 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.244545 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.244852 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.245175 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.245508 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.245837 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.246179 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.246487 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.246803 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.247113 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.247427 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.247734 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.248048 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.248369 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.248674 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.248998 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.249311 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.249618 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.249967 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.250275 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.250582 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.250899 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.251213 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.251526 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.251838 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.252152 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.252477 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.252792 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.253114 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.253467 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.253926 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.254328 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.254639 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.254861 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.255164 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.255311 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.255609 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.255923 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.256233 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.256579 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.256852 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.257164 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.257476 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.257801 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.258117 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.258438 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.258766 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.259111 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.259419 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.259727 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.260032 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.260384 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.260694 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.261042 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.261388 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.261727 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.262054 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.262369 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.262692 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.263005 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.263326 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.263640 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.263951 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.264274 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.264587 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.264908 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.265222 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.265551 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.265893 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.266217 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.266531 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.266849 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.267187 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.267522 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.267840 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.268165 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.268485 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.268800 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.269111 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.269425 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.269759 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.270076 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.270396 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.270709 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.271029 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.271348 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.271672 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.271985 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.272301 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.272611 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.272923 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.273259 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.273590 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.273953 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.274270 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.275134 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.275432 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.275746 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.276059 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.276381 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.276708 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.277025 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.277342 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.277657 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.277986 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.278294 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.278616 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.278926 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.279232 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.279540 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.279854 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.280186 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.280496 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.280824 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.281145 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.281453 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.281788 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.282113 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.282425 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.282731 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.283040 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.283349 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.283695 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.284012 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.284426 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.284909 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.284909 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.288309 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.288309 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.288309 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.288309 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.288309 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.288309 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.288309 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.288309 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.293796 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.293796 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.293796 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.293796 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.293796 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.293796 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.293796 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.293796 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.294779 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.294779 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.294779 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.294779 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.294779 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.294779 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.294779 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.294779 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.295672 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.295672 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.295672 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.295672 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.295672 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.295672 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.295672 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.296302 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.296302 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.296437 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.296663 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 12:45:14.297565 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.297739 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 12:45:14.297884 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.297884 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.298190 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 12:45:14.298342 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.298536 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 12:45:14.298733 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.298887 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 12:45:14.299051 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.299202 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.299401 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.299552 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.299710 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.299865 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.300092 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.300257 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.300421 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.300421 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.300697 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.300854 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.301008 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.301151 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.301301 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.301461 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.301611 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.301812 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.301979 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.302129 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.302280 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.302431 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.302591 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.302753 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.302970 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815712-9-iscsi {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.303142 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.303283 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.303283 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.303582 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.303582 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.303881 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.304036 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.304194 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.304194 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.304479 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.304479 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.304775 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.304869 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.304952 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.305035 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.305131 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.305295 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.305432 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.305581 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.305776 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.305974 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.306122 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.306268 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.306410 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.306589 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.306589 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.306952 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.307169 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.307335 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.307540 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.307752 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.307912 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.308133 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.308294 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.308442 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.308648 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.308875 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.308995 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.309095 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815712-9-iscsi {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.309181 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.309271 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.309424 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.309641 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.309882 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.310054 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.310206 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.310206 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.310494 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.310665 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.310816 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.310963 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.311109 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.311313 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.311420 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.311514 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.311598 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.311774 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.311927 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.312100 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.312262 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.312439 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.312600 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.312761 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.312911 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.313075 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.313244 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.313448 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.313603 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.313796 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.313959 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.314070 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.314294 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.314435 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.314527 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.314609 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.314705 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.314787 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.314877 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.314968 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.315058 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.315151 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.315240 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.315323 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.315459 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.315547 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.315628 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.315715 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.315804 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.315959 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.316050 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.316133 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.316214 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.316308 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.316423 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.316603 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.316750 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.316916 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.317069 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.317266 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.317419 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.317549 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.317692 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.317876 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.318004 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.318127 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.318311 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.318430 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.318619 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.318751 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.318941 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.319055 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.319202 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.319531 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.319855 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.320187 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.320303 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.320502 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.320700 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.320813 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.320927 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.321169 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.321295 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.41 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.321502 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.41 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.321628 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.321850 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.321972 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.322180 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.322306 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.322506 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.322622 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.322821 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.322938 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.323139 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.323265 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.323456 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.323582 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.323767 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.323883 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.325735 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.325937 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.326099 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.326246 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.326377 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.326500 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.326629 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.326757 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.326900 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.327023 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.327162 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.327290 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.327440 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.327613 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.327749 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.327907 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.328036 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.328152 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.328292 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.328422 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.328538 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.328653 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.328781 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.328895 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.329008 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.329125 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.329240 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.329363 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.329485 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.329616 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.329867 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.330036 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.330171 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.330293 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.330419 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.330548 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.330678 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.330800 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.330928 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.331057 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.331182 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.331297 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.331388 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.331467 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.331545 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.331616 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.331616 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.331738 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.331815 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.331886 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.331981 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.332097 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.332228 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.332935 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.333094 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.333187 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.333260 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.333351 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.333424 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.333520 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.333599 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.333689 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.333763 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.334005 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.334110 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.334307 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.334402 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.335680 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.335807 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.335893 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.335972 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.336044 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.336125 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.336199 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.336283 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.336354 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.336429 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.336499 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.336567 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.336633 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.336710 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.336786 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.336865 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.337760 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.337872 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.338019 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.338124 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.338331 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.338435 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.338641 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.338736 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.338949 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.339044 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.339259 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.339362 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.339566 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.339669 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.339874 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.339977 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.340177 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.340275 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.340494 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.340589 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.340899 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.341010 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.341093 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.341171 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.341415 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.341520 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.341753 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.341851 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.342077 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.342172 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:45:14.342420 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.342526 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.342761 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.342857 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.343089 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.343183 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.343423 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.343527 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.343764 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.343862 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.344101 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.344204 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.344758 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.344957 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.344957 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.345968 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.346135 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.346281 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.346281 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.346676 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.346820 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.346968 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.347120 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.347276 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.347443 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.347594 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.347736 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.347928 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.348072 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.348213 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.348378 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.348574 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.348726 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.348868 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.349008 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.349163 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.349313 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.349466 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.349616 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.349791 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.349935 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.350091 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.350091 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.350362 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.350510 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.350652 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.350801 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.350970 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.350970 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.351785 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.351950 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.352101 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.352253 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.352405 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.352556 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.352721 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.353390 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.353535 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.353723 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.353874 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.354016 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.354157 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.354309 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.354514 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.354828 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.355055 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.355220 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.356257 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.356417 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.356572 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.356731 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.356875 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.357025 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.357179 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.357322 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.357484 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.357740 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.357892 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.358071 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.358244 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.358389 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.358389 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.358670 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.358821 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.358964 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.359123 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.359266 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.359421 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.359584 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.359728 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.359869 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.360018 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.360168 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.360323 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.360323 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.360603 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.360753 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.360903 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.361045 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.361200 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.361343 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.361503 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.361856 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.362059 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.362059 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.362362 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.362513 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.362664 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.362808 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.362949 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.363104 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.363246 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.363404 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.363555 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.363765 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.363947 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.363947 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.364354 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.364354 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.364711 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.364711 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.364992 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.365213 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.365358 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.365815 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.366458 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.366633 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.366792 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.366936 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.367086 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.367236 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.367386 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.367527 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.367527 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.367816 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.367960 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.367960 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.368251 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.368544 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.368544 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.368851 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.368993 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.368993 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.369262 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.369402 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.369402 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.369707 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.369868 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.370010 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.370163 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.370316 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.370458 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.370610 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.370760 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.370902 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.371051 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.371331 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.371506 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.371660 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.371902 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.372063 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.372209 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.372359 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.372503 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.372657 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.372807 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.372950 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.373099 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.373099 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.373381 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.373532 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.373735 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.373884 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.374038 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.374188 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.374331 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.374480 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.374641 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.374791 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.374942 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.375093 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.375235 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.375391 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.375543 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.375969 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.376419 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.376419 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.376916 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.377059 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.377200 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.377353 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.377510 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.377681 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.377831 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.377973 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.378113 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.378266 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.378422 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.378567 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.378708 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.378858 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.379000 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.379155 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.379308 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.379450 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.379605 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.379748 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.379896 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.380256 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.380413 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.380565 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.380792 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.380936 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.381086 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.381243 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.381416 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.381567 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.381759 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.381915 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.382255 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.382459 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.382652 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.382856 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.383038 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.383197 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.383392 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.383575 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.383804 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.383989 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.384149 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.384311 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.384454 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.384646 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.384827 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.385159 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.385325 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.385485 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.385638 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.385917 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.386253 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.386253 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.387056 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.387256 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.387403 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.387545 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.387687 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.387828 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.387970 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.388126 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.388269 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.388418 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.388561 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.388721 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.388873 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.389025 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.389168 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.389308 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.389450 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.389591 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.389817 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.389964 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.390106 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.390246 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.390387 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.390387 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.390674 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.390826 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.390967 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.391109 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.391248 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.391389 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.391542 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.391686 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.391827 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.391977 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.392233 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.392233 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.392522 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.392675 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.392880 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.393028 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.393028 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.393380 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.393523 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.393681 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.393842 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.393992 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.394149 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.394149 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.394449 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.394616 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.394765 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.394961 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.395117 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.395284 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.395452 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.395602 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.395757 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.395757 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.396466 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.397271 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.397467 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.397619 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.397854 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.398004 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.398244 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.398431 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.398674 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.398875 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.399026 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.399175 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.399344 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.399503 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.400331 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.400488 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.400645 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.400807 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.400970 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.401129 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.401293 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.401451 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.401609 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.401859 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.402111 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.402478 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.402649 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.402801 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.402950 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.403112 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.403274 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.403432 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.403591 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.403740 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.403888 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.403888 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.404187 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.404334 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.404488 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.404636 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.404785 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.404944 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.405112 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.405932 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.406159 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.406341 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.407041 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.407387 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.407558 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.407716 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.407876 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.410832 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.411039 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.411209 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.411364 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.411535 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.411694 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.411844 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.412008 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.412162 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.412319 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.412599 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.412599 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.412916 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.413082 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.413240 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.413390 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.413546 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.413728 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.413901 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.414059 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.414220 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.414377 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.414526 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.414674 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.414835 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.415000 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.415191 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.415876 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.416032 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.416189 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.416361 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.416511 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.416906 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.417413 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.417744 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.417915 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.418077 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.418431 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.418599 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.418599 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.419038 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.419253 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.419487 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.419645 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.419806 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.419958 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.420120 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.420278 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.420278 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.420587 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.420587 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.420996 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.421167 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.421318 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.421467 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.421467 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.421913 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.422076 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.422237 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.422387 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.422668 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.422848 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.423006 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.423166 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.423325 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.423485 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.423636 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.423793 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.423962 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.424122 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.424280 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.424430 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.424591 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.424743 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.424891 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.425038 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.425186 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.425342 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.425507 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.425658 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.425865 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.426024 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.426174 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.427181 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.427774 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.428140 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.428298 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.428473 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.428763 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.428934 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.429086 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.429243 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.429402 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.429571 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.429738 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.429913 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.430074 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.430231 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.430389 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.430547 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.430703 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.430901 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.431162 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.431373 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.431538 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.431696 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.431873 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.432035 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.432742 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.432992 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.433157 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.433315 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.433481 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.433631 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.433879 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.434031 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.434031 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.434378 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.434549 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.434700 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.435050 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.435319 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.435486 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.435654 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.435911 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.436163 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.436383 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.436591 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.436754 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.436917 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.437099 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.437478 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.437970 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.438165 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.438351 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.438519 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.438678 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.439091 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.439313 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.439472 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.439632 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.439796 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.439955 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.440117 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.440267 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.440417 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.440567 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.440748 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.440913 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.441061 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.441365 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.441524 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.441754 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.441914 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.442076 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.442226 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.442394 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.442554 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.442715 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.442866 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.443142 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.443307 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.443458 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.443616 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.443775 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.443926 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.444083 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.444241 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.444391 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.444558 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.444722 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.444909 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.445070 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.445310 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.445486 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.445658 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.445835 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.445984 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.446133 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.446280 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.446474 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.446659 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.446811 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.446967 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.447117 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.447502 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.447667 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.448182 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.448350 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.448500 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.448657 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.448816 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.449252 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.449420 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.449593 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.450405 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.450575 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.450737 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.450899 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.451050 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.451199 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.451374 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.451642 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.451797 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.451963 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.452114 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.452271 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.452433 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.452583 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.452732 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.452890 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.453042 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.453322 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.453480 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.453637 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.453841 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.454008 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.454159 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.454309 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.454457 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.454616 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.454780 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.454780 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.455183 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.455183 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.455503 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.455669 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.455963 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.456135 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.456287 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.456434 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.456583 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.456743 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.456902 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.457053 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.457203 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.457351 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.457718 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.457891 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.458347 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.458506 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.458655 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.458804 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.458961 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.459139 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.459658 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.459822 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.459982 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.460139 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.460291 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.460481 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.460733 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.460939 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.461093 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.461244 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.461403 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.461814 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.462013 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.462714 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.462864 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.463026 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.463186 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.463445 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.463604 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.463762 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.463762 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.464055 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.464290 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.464451 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.464614 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.464614 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.464959 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.465109 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.465109 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.465405 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.465564 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.465564 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.465887 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.466047 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 12:45:14.466212 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.466212 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.466212 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.466212 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.466212 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.466212 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.466212 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.466212 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.468163 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.468163 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.468163 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.468163 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.468163 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.468163 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.468163 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.468163 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.469822 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.469822 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.469822 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.469822 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.469822 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.469822 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.469822 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.469822 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.470997 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.470997 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.470997 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.470997 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.470997 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.470997 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.470997 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.470997 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.472411 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.472411 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.472411 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.472411 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.472411 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.472411 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.472411 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.472411 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.473654 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.473654 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.473654 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.473654 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.473654 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.473654 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.473654 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.473654 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.474859 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.474859 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.474859 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.474859 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.474859 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.474859 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.474859 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.474859 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.477001 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.477001 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.477001 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.477001 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.477001 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.477001 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.477001 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.477001 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.478448 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.478448 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.478448 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.478448 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.478448 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.478448 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.478448 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.478448 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.480101 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.480101 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.480101 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.480101 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.480101 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.480101 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.480101 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.480101 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.481266 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.481266 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.481266 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.481266 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.481266 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.481266 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.481266 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.481266 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.482581 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.482581 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.482581 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.482581 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.482581 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.482581 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.482581 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.482581 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.483811 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.483811 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.483811 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.483811 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.483811 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.483811 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.483811 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.483811 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.484975 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.484975 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.484975 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.484975 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.484975 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.484975 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.484975 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.484975 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.486249 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.486249 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.486249 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.486249 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.486249 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.486249 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.486249 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.486249 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.487406 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.487406 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.487406 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.487406 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.488146 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.488146 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.488445 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.488683 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.489012 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.489175 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.489501 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.489854 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.490229 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.490509 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.490828 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.491159 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.491483 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.491807 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.492143 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.492450 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.492776 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.493100 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.494012 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.494334 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.494651 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.494976 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.495301 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.495883 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.496222 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.496546 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.496870 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.497192 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.497514 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.497934 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.498258 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.498564 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.498886 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.499262 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.499527 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.499858 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.500334 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.500534 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.500860 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.501184 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.501508 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.501857 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.502252 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.502545 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.502860 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.503182 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.503509 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.503832 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.504159 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.504725 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.504899 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO dbcounter [None req-6dd4f4d5-3b7f-4155-a7ce-0b712dcee0af None None] Registered counter for database nova_api May 26 12:45:14.505056 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.505284 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.505604 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.505953 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.506278 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.506604 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.506940 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.507286 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.507598 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.507922 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.508317 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.508648 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.509956 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.510133 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.510595 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.510764 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.511097 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.511423 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.512125 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.512125 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.512580 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.512746 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.512982 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.513297 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.513609 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.513969 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.514290 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.514600 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.514926 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.515241 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.515793 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.516150 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.516474 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.516809 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.517141 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.517465 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.517805 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.518138 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.518479 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.518759 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.519302 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.519480 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.519691 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.520042 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.520363 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.520750 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.521019 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.522708 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.522708 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.522708 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.522708 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.522708 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.523779 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.523779 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.523779 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.524609 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.524609 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.524609 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.525263 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.525263 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.526679 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.526679 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.526679 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.526679 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.527659 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_db.sqlalchemy.engines [None req-6dd4f4d5-3b7f-4155-a7ce-0b712dcee0af None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124824) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 12:45:14.527822 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.527822 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.527822 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.527822 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.528589 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.528589 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.528996 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.528996 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.529288 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.529577 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.529940 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.530353 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.530938 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.531331 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.531528 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.531831 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.532171 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.532485 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.532800 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.533111 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.533443 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.533786 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.534112 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.534430 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.534698 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG dbcounter [-] [124824] Writer thread running {{(pid=124824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 12:45:14.534870 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.535170 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.535363 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.535658 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.535974 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.536380 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.536713 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.537035 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.537352 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.537690 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.538016 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.538368 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.538698 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.539023 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.539341 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.539665 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.540890 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.540890 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.540890 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.541528 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.541528 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.541845 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.541996 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.542302 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.542633 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.542955 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.543277 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.543604 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.543929 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.544258 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.544589 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.544908 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.545237 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.545554 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.545915 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.546264 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.546626 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.546916 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.547230 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.547541 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.547850 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.548166 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.548493 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.548812 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.549123 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.549434 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.549778 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.550090 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.550405 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.550717 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.551044 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.551340 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.552150 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.552150 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.552577 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.552577 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.552880 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.553128 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.553445 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.553784 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.554099 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.554410 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.554721 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.555121 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.555525 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.556367 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.556651 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.556982 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.557299 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.557628 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.557968 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.558296 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.558626 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.558953 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.559269 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.559606 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.559923 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.560237 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.560556 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.560872 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.561212 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.561518 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.561863 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.562197 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.562510 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.562843 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.563307 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.563472 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.564410 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.564410 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.564410 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.564901 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.565166 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.565347 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.565855 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.566025 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.566313 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.566635 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.566967 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.567300 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.567618 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.567950 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.568285 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.568645 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.569135 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.569331 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.569633 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.570002 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.570426 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.570614 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:45:14.570840 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 12:45:14.592059 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.context [None req-6dd4f4d5-3b7f-4155-a7ce-0b712dcee0af None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8040d8fc-4b5c-4b3f-be84-000e94e5def8(cell1) {{(pid=124824) load_cells /opt/stack/nova/nova/context.py:464}} May 26 12:45:14.596218 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-6dd4f4d5-3b7f-4155-a7ce-0b712dcee0af None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:14.597820 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-6dd4f4d5-3b7f-4155-a7ce-0b712dcee0af None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:14.598616 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-6dd4f4d5-3b7f-4155-a7ce-0b712dcee0af None None] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:14.600564 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-6dd4f4d5-3b7f-4155-a7ce-0b712dcee0af None None] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:14.603383 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO dbcounter [None req-6dd4f4d5-3b7f-4155-a7ce-0b712dcee0af None None] Registered counter for database nova_cell0 May 26 12:45:14.607794 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO dbcounter [None req-6dd4f4d5-3b7f-4155-a7ce-0b712dcee0af None None] Registered counter for database nova_cell1 May 26 12:45:14.615093 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_db.sqlalchemy.engines [None req-6dd4f4d5-3b7f-4155-a7ce-0b712dcee0af None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124824) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 12:45:14.617335 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_db.sqlalchemy.engines [None req-6dd4f4d5-3b7f-4155-a7ce-0b712dcee0af None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124824) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 12:45:14.623115 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG dbcounter [-] [124824] Writer thread running {{(pid=124824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 12:45:14.625621 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG dbcounter [-] [124824] Writer thread running {{(pid=124824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 12:45:14.632089 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO dbcounter [None req-a7fa3c5f-9987-49a3-9dc7-f08b635c952d None None] Registered counter for database nova_api May 26 12:45:14.651902 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_db.sqlalchemy.engines [None req-a7fa3c5f-9987-49a3-9dc7-f08b635c952d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124823) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 12:45:14.659397 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG dbcounter [-] [124823] Writer thread running {{(pid=124823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 12:45:14.716595 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.context [None req-a7fa3c5f-9987-49a3-9dc7-f08b635c952d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8040d8fc-4b5c-4b3f-be84-000e94e5def8(cell1) {{(pid=124823) load_cells /opt/stack/nova/nova/context.py:464}} May 26 12:45:14.720789 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-a7fa3c5f-9987-49a3-9dc7-f08b635c952d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:14.722400 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-a7fa3c5f-9987-49a3-9dc7-f08b635c952d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:14.723212 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-a7fa3c5f-9987-49a3-9dc7-f08b635c952d None None] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:45:14.725187 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-a7fa3c5f-9987-49a3-9dc7-f08b635c952d None None] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:45:14.727463 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO dbcounter [None req-a7fa3c5f-9987-49a3-9dc7-f08b635c952d None None] Registered counter for database nova_cell0 May 26 12:45:14.731981 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO dbcounter [None req-a7fa3c5f-9987-49a3-9dc7-f08b635c952d None None] Registered counter for database nova_cell1 May 26 12:45:14.739690 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_db.sqlalchemy.engines [None req-a7fa3c5f-9987-49a3-9dc7-f08b635c952d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124823) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 12:45:14.741331 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_db.sqlalchemy.engines [None req-a7fa3c5f-9987-49a3-9dc7-f08b635c952d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124823) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 12:45:14.748985 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG dbcounter [-] [124823] Writer thread running {{(pid=124823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 12:45:14.749323 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG dbcounter [-] [124823] Writer thread running {{(pid=124823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 12:45:14.772235 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO dbcounter [None req-6dd4f4d5-3b7f-4155-a7ce-0b712dcee0af None None] Registered counter for database nova_cell0 May 26 12:45:14.779205 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_db.sqlalchemy.engines [None req-6dd4f4d5-3b7f-4155-a7ce-0b712dcee0af None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124824) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 12:45:14.783963 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG dbcounter [-] [124824] Writer thread running {{(pid=124824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 12:45:14.899462 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO dbcounter [None req-a7fa3c5f-9987-49a3-9dc7-f08b635c952d None None] Registered counter for database nova_cell0 May 26 12:45:14.906348 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_db.sqlalchemy.engines [None req-a7fa3c5f-9987-49a3-9dc7-f08b635c952d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124823) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 12:45:14.911140 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG dbcounter [-] [124823] Writer thread running {{(pid=124823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 12:45:15.118834 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: WARNING keystonemiddleware.auth_token [None req-6dd4f4d5-3b7f-4155-a7ce-0b712dcee0af None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 12:45:15.126283 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: WARNING keystonemiddleware.auth_token [None req-6dd4f4d5-3b7f-4155-a7ce-0b712dcee0af None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 12:45:15.238642 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: WARNING keystonemiddleware.auth_token [None req-a7fa3c5f-9987-49a3-9dc7-f08b635c952d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 12:45:15.246455 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: WARNING keystonemiddleware.auth_token [None req-a7fa3c5f-9987-49a3-9dc7-f08b635c952d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 12:45:15.493546 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: WARNING keystonemiddleware.auth_token [None req-6dd4f4d5-3b7f-4155-a7ce-0b712dcee0af None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 12:45:15.499646 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: WARNING keystonemiddleware.auth_token [None req-6dd4f4d5-3b7f-4155-a7ce-0b712dcee0af None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 12:45:15.504998 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562d877ed9c0 pid: 124824 (default app) May 26 12:45:15.594003 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: WARNING keystonemiddleware.auth_token [None req-a7fa3c5f-9987-49a3-9dc7-f08b635c952d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 12:45:15.600132 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: WARNING keystonemiddleware.auth_token [None req-a7fa3c5f-9987-49a3-9dc7-f08b635c952d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 12:45:15.606577 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562d877ed9c0 pid: 124823 (default app) May 26 12:46:01.407594 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG dbcounter [-] [124824] Writing DB stats nova_api:SELECT=3 {{(pid=124824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:46:01.408456 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG dbcounter [-] [124824] Writing DB stats nova_cell0:SELECT=3 {{(pid=124824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:46:01.409605 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG dbcounter [-] [124824] Writing DB stats nova_cell1:SELECT=3 {{(pid=124824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:46:01.410530 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG dbcounter [-] [124824] Writing DB stats nova_cell0:SELECT=3 {{(pid=124824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:46:01.910128 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-64570a5d-c5d6-4c0f-8c9c-1f191f138f32 tempest-VolumesSnapshotsTestJSON-2055236343 tempest-VolumesSnapshotsTestJSON-2055236343-project] Action: 'create', calling method: .version_select at 0x7f26a3f3bf70>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-588646294"}} {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:46:04.286625 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG dbcounter [-] [124823] Writing DB stats nova_api:SELECT=3 {{(pid=124823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:46:04.287901 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG dbcounter [-] [124823] Writing DB stats nova_cell0:SELECT=3 {{(pid=124823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:46:04.289536 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG dbcounter [-] [124823] Writing DB stats nova_cell1:SELECT=3 {{(pid=124823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:46:04.291253 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG dbcounter [-] [124823] Writing DB stats nova_cell0:SELECT=3 {{(pid=124823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:46:04.541686 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-64570a5d-c5d6-4c0f-8c9c-1f191f138f32 tempest-VolumesSnapshotsTestJSON-2055236343 tempest-VolumesSnapshotsTestJSON-2055236343-project] 10.222.0.41 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.138413 May 26 12:46:04.542966 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 1/1] 10.222.0.41 () {60 vars in 1154 bytes} [Thu May 26 12:46:01 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 3143 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 26 12:46:04.555623 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-f17be339-789b-4f11-8166-1226bdac88c1 tempest-VolumesSnapshotsTestJSON-2055236343 tempest-VolumesSnapshotsTestJSON-2055236343-project] Calling method '.version_select at 0x7f26a3e62a60>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:04.700250 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-f17be339-789b-4f11-8166-1226bdac88c1 tempest-VolumesSnapshotsTestJSON-2055236343 tempest-VolumesSnapshotsTestJSON-2055236343-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/fb31eb60-d419-4a58-b735-c01e5dceda03" status: 200 len: 344 microversion: 2.1 time: 0.138830 May 26 12:46:04.700250 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 2/2] 10.222.0.41 () {58 vars in 1244 bytes} [Thu May 26 12:46:04 2022] GET /compute/v2.1/os-volumes/fb31eb60-d419-4a58-b735-c01e5dceda03 => generated 344 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:46:04.729441 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-f225b1e6-fcff-4bb8-a73b-896eb618ec69 tempest-VolumesTestJSON-913756250 tempest-VolumesTestJSON-913756250-project] Calling method '.version_select at 0x7f26a3e50790>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:05.675506 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-3621e91e-c7ed-4c19-bb8f-46d76bbe41db tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-732783023", "imageRef": "6df25342-b071-489b-a7c1-3089fa19af6d", "flavorRef": "452", "networks": [{"uuid": "2622212e-1789-4046-a566-cfc6c4a3becf"}]}} {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:46:05.826736 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.network.neutron [None req-3621e91e-c7ed-4c19-bb8f-46d76bbe41db tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] validate_networks() for [('2622212e-1789-4046-a566-cfc6c4a3becf', None, None, None, None, None)] {{(pid=124824) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 12:46:05.943115 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-f225b1e6-fcff-4bb8-a73b-896eb618ec69 tempest-VolumesTestJSON-913756250 tempest-VolumesTestJSON-913756250-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/21c77eb0-2675-42db-8c1e-a291504560b9" status: 200 len: 351 microversion: 2.1 time: 1.662508 May 26 12:46:05.951049 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 1/3] 10.222.0.41 () {58 vars in 1244 bytes} [Thu May 26 12:46:04 2022] GET /compute/v2.1/os-volumes/21c77eb0-2675-42db-8c1e-a291504560b9 => generated 351 bytes in 1672 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:46:05.957224 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-5726cbe6-66b3-4396-a347-492282cc083b tempest-VolumesSnapshotsTestJSON-2055236343 tempest-VolumesSnapshotsTestJSON-2055236343-project] Calling method '.version_select at 0x7f26a3d19ee0>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:06.933508 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-5726cbe6-66b3-4396-a347-492282cc083b tempest-VolumesSnapshotsTestJSON-2055236343 tempest-VolumesSnapshotsTestJSON-2055236343-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/fb31eb60-d419-4a58-b735-c01e5dceda03" status: 200 len: 345 microversion: 2.1 time: 0.980781 May 26 12:46:06.941302 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 2/4] 10.222.0.41 () {58 vars in 1244 bytes} [Thu May 26 12:46:05 2022] GET /compute/v2.1/os-volumes/fb31eb60-d419-4a58-b735-c01e5dceda03 => generated 345 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:46:06.954875 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-5bfa375f-b04d-4f4c-9ba6-914825623fb1 tempest-VolumesSnapshotsTestJSON-2055236343 tempest-VolumesSnapshotsTestJSON-2055236343-project] Action: 'create', calling method: .version_select at 0x7f26a3cd53a0>, body: {"snapshot": {"volume_id": "fb31eb60-d419-4a58-b735-c01e5dceda03", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-150316940"}} {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:46:07.570874 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.virt.hardware [None req-3621e91e-c7ed-4c19-bb8f-46d76bbe41db tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Flavor limits 0:0:0 {{(pid=124824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 12:46:07.571261 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.virt.hardware [None req-3621e91e-c7ed-4c19-bb8f-46d76bbe41db tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Image limits 0:0:0 {{(pid=124824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 12:46:07.572142 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.virt.hardware [None req-3621e91e-c7ed-4c19-bb8f-46d76bbe41db tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Flavor pref 0:0:0 {{(pid=124824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 12:46:07.572582 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.virt.hardware [None req-3621e91e-c7ed-4c19-bb8f-46d76bbe41db tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Image pref 0:0:0 {{(pid=124824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 12:46:07.573007 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.virt.hardware [None req-3621e91e-c7ed-4c19-bb8f-46d76bbe41db tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 12:46:07.607453 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-3621e91e-c7ed-4c19-bb8f-46d76bbe41db tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:07.607904 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-3621e91e-c7ed-4c19-bb8f-46d76bbe41db tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:07.610000 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-3621e91e-c7ed-4c19-bb8f-46d76bbe41db tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:07.614259 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-3621e91e-c7ed-4c19-bb8f-46d76bbe41db tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:07.657643 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.quota [None req-3621e91e-c7ed-4c19-bb8f-46d76bbe41db tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Getting quotas for project 3cd0ea68fb8a43e886d0c9722d766ba6. Resources: {'instances', 'ram', 'cores'} {{(pid=124824) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:46:07.672149 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.quota [None req-3621e91e-c7ed-4c19-bb8f-46d76bbe41db tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Getting quotas for user 4d380efbe8c44fb3bbc58c9913cb25e6 and project 3cd0ea68fb8a43e886d0c9722d766ba6. Resources: {'instances', 'ram', 'cores'} {{(pid=124824) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:46:07.682336 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-3621e91e-c7ed-4c19-bb8f-46d76bbe41db tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Going to run 1 instances... {{(pid=124824) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 12:46:07.686080 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-3621e91e-c7ed-4c19-bb8f-46d76bbe41db tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] [instance: d3b264dc-45ea-4e2f-8e62-42f1b7424d50] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6df25342-b071-489b-a7c1-3089fa19af6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124824) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 12:46:07.752804 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-5bfa375f-b04d-4f4c-9ba6-914825623fb1 tempest-VolumesSnapshotsTestJSON-2055236343 tempest-VolumesSnapshotsTestJSON-2055236343-project] 10.222.0.41 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.804957 May 26 12:46:07.754011 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 3/5] 10.222.0.41 () {60 vars in 1161 bytes} [Thu May 26 12:46:06 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:46:07.764400 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-09e31b14-c4fe-4e14-95be-65136038a103 tempest-VolumesSnapshotsTestJSON-2055236343 tempest-VolumesSnapshotsTestJSON-2055236343-project] Calling method '.version_select at 0x7f26a3d19ca0>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:07.807802 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-09e31b14-c4fe-4e14-95be-65136038a103 tempest-VolumesSnapshotsTestJSON-2055236343 tempest-VolumesSnapshotsTestJSON-2055236343-project] 10.222.0.41 "GET /compute/v2.1/os-snapshots/feaeecf1-a39d-4a1f-a296-c78a578617d2" status: 200 len: 286 microversion: 2.1 time: 0.047549 May 26 12:46:07.810007 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 4/6] 10.222.0.41 () {58 vars in 1250 bytes} [Thu May 26 12:46:07 2022] GET /compute/v2.1/os-snapshots/feaeecf1-a39d-4a1f-a296-c78a578617d2 => generated 286 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:46:07.821456 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-a7e32969-66af-4d52-b13c-e39a7b0cd5af tempest-VolumesSnapshotsTestJSON-2055236343 tempest-VolumesSnapshotsTestJSON-2055236343-project] Calling method '.version_select at 0x7f26a3cd5af0>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:07.925821 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-a7e32969-66af-4d52-b13c-e39a7b0cd5af tempest-VolumesSnapshotsTestJSON-2055236343 tempest-VolumesSnapshotsTestJSON-2055236343-project] 10.222.0.41 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.108948 May 26 12:46:07.932923 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 5/7] 10.222.0.41 () {58 vars in 1139 bytes} [Thu May 26 12:46:07 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:46:07.943762 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-79f5ac43-3aff-4fcc-90df-5f08f5ae4c0b tempest-VolumesSnapshotsTestJSON-2055236343 tempest-VolumesSnapshotsTestJSON-2055236343-project] Calling method '.version_select at 0x7f26a3ce4820>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:07.952968 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-3621e91e-c7ed-4c19-bb8f-46d76bbe41db tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.657238 May 26 12:46:07.957557 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 3/8] 10.222.0.41 () {60 vars in 1146 bytes} [Thu May 26 12:46:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 2659 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 12:46:07.968686 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-e4cc5eeb-f5bf-467d-89cc-66dc1fca281c tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:07.969480 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-e4cc5eeb-f5bf-467d-89cc-66dc1fca281c tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] [instance: d3b264dc-45ea-4e2f-8e62-42f1b7424d50] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:07.999232 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-79f5ac43-3aff-4fcc-90df-5f08f5ae4c0b tempest-VolumesSnapshotsTestJSON-2055236343 tempest-VolumesSnapshotsTestJSON-2055236343-project] 10.222.0.41 "GET /compute/v2.1/os-snapshots/feaeecf1-a39d-4a1f-a296-c78a578617d2" status: 200 len: 286 microversion: 2.1 time: 0.061428 May 26 12:46:08.002531 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 6/9] 10.222.0.41 () {58 vars in 1250 bytes} [Thu May 26 12:46:07 2022] GET /compute/v2.1/os-snapshots/feaeecf1-a39d-4a1f-a296-c78a578617d2 => generated 286 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:46:08.552278 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-e4cc5eeb-f5bf-467d-89cc-66dc1fca281c tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d380efbe8c44fb3bbc58c9913cb25e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd0ea68fb8a43e886d0c9722d766ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:08.580442 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-e4cc5eeb-f5bf-467d-89cc-66dc1fca281c tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] 10.222.0.41 "GET /compute/v2.1/servers/d3b264dc-45ea-4e2f-8e62-42f1b7424d50" status: 200 len: 1214 microversion: 2.1 time: 0.616918 May 26 12:46:08.584197 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 4/10] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:46:07 2022] GET /compute/v2.1/servers/d3b264dc-45ea-4e2f-8e62-42f1b7424d50 => generated 1214 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:46:09.032143 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-d6d636d8-f512-4421-87b9-a0920c35a4cb tempest-VolumesSnapshotsTestJSON-2055236343 tempest-VolumesSnapshotsTestJSON-2055236343-project] Calling method '.version_select at 0x7f26a3cd5160>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:09.159092 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-d6d636d8-f512-4421-87b9-a0920c35a4cb tempest-VolumesSnapshotsTestJSON-2055236343 tempest-VolumesSnapshotsTestJSON-2055236343-project] 10.222.0.41 "GET /compute/v2.1/os-snapshots/feaeecf1-a39d-4a1f-a296-c78a578617d2" status: 200 len: 286 microversion: 2.1 time: 0.146417 May 26 12:46:09.166247 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 7/11] 10.222.0.41 () {58 vars in 1250 bytes} [Thu May 26 12:46:09 2022] GET /compute/v2.1/os-snapshots/feaeecf1-a39d-4a1f-a296-c78a578617d2 => generated 286 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:46:09.604499 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-2a0c68e4-fff6-427c-9a03-f432267ff6b3 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:09.605760 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-2a0c68e4-fff6-427c-9a03-f432267ff6b3 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] [instance: d3b264dc-45ea-4e2f-8e62-42f1b7424d50] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:09.755453 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-2a0c68e4-fff6-427c-9a03-f432267ff6b3 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d380efbe8c44fb3bbc58c9913cb25e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd0ea68fb8a43e886d0c9722d766ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:09.768659 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-2a0c68e4-fff6-427c-9a03-f432267ff6b3 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] 10.222.0.41 "GET /compute/v2.1/servers/d3b264dc-45ea-4e2f-8e62-42f1b7424d50" status: 200 len: 1214 microversion: 2.1 time: 0.169186 May 26 12:46:09.775537 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 5/12] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:46:09 2022] GET /compute/v2.1/servers/d3b264dc-45ea-4e2f-8e62-42f1b7424d50 => generated 1214 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:46:10.174229 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-4d81d848-aed6-4d64-9f78-71e2178f9c8b tempest-VolumesSnapshotsTestJSON-2055236343 tempest-VolumesSnapshotsTestJSON-2055236343-project] Calling method '.version_select at 0x7f26a3d19b80>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:10.257854 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-4d81d848-aed6-4d64-9f78-71e2178f9c8b tempest-VolumesSnapshotsTestJSON-2055236343 tempest-VolumesSnapshotsTestJSON-2055236343-project] 10.222.0.41 "GET /compute/v2.1/os-snapshots/feaeecf1-a39d-4a1f-a296-c78a578617d2" status: 200 len: 286 microversion: 2.1 time: 0.087847 May 26 12:46:10.265423 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 8/13] 10.222.0.41 () {58 vars in 1250 bytes} [Thu May 26 12:46:10 2022] GET /compute/v2.1/os-snapshots/feaeecf1-a39d-4a1f-a296-c78a578617d2 => generated 286 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:46:10.794308 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-00dee795-a7b6-413d-a24c-69f647a9bd9d tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:10.795016 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-00dee795-a7b6-413d-a24c-69f647a9bd9d tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] [instance: d3b264dc-45ea-4e2f-8e62-42f1b7424d50] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:10.963072 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-00dee795-a7b6-413d-a24c-69f647a9bd9d tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d380efbe8c44fb3bbc58c9913cb25e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd0ea68fb8a43e886d0c9722d766ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:10.975630 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-00dee795-a7b6-413d-a24c-69f647a9bd9d tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] 10.222.0.41 "GET /compute/v2.1/servers/d3b264dc-45ea-4e2f-8e62-42f1b7424d50" status: 200 len: 1214 microversion: 2.1 time: 0.185651 May 26 12:46:10.978437 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 6/14] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:46:10 2022] GET /compute/v2.1/servers/d3b264dc-45ea-4e2f-8e62-42f1b7424d50 => generated 1214 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:46:11.272396 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-dc1983b4-0f9d-48ce-8e41-16973e4af693 tempest-VolumesSnapshotsTestJSON-2055236343 tempest-VolumesSnapshotsTestJSON-2055236343-project] Calling method '.version_select at 0x7f26a46641f0>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:11.333659 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-dc1983b4-0f9d-48ce-8e41-16973e4af693 tempest-VolumesSnapshotsTestJSON-2055236343 tempest-VolumesSnapshotsTestJSON-2055236343-project] 10.222.0.41 "GET /compute/v2.1/os-snapshots/feaeecf1-a39d-4a1f-a296-c78a578617d2" status: 200 len: 286 microversion: 2.1 time: 0.065578 May 26 12:46:11.334529 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 9/15] 10.222.0.41 () {58 vars in 1250 bytes} [Thu May 26 12:46:11 2022] GET /compute/v2.1/os-snapshots/feaeecf1-a39d-4a1f-a296-c78a578617d2 => generated 286 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:46:12.000748 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-a0c5c502-3604-43d8-b90b-42fea5ebffb0 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:12.001979 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-a0c5c502-3604-43d8-b90b-42fea5ebffb0 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] [instance: d3b264dc-45ea-4e2f-8e62-42f1b7424d50] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:12.011862 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-a0c5c502-3604-43d8-b90b-42fea5ebffb0 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:12.012617 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-a0c5c502-3604-43d8-b90b-42fea5ebffb0 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:12.017093 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-a0c5c502-3604-43d8-b90b-42fea5ebffb0 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:12.017093 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-a0c5c502-3604-43d8-b90b-42fea5ebffb0 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:12.349287 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-2dd3c31c-16ed-44cc-a381-b47fed41c63a tempest-VolumesSnapshotsTestJSON-2055236343 tempest-VolumesSnapshotsTestJSON-2055236343-project] Calling method '.version_select at 0x7f26a3ce4670>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:12.435083 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-2dd3c31c-16ed-44cc-a381-b47fed41c63a tempest-VolumesSnapshotsTestJSON-2055236343 tempest-VolumesSnapshotsTestJSON-2055236343-project] 10.222.0.41 "GET /compute/v2.1/os-snapshots/feaeecf1-a39d-4a1f-a296-c78a578617d2" status: 200 len: 286 microversion: 2.1 time: 0.090304 May 26 12:46:12.439760 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 10/16] 10.222.0.41 () {58 vars in 1250 bytes} [Thu May 26 12:46:12 2022] GET /compute/v2.1/os-snapshots/feaeecf1-a39d-4a1f-a296-c78a578617d2 => generated 286 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:46:12.502052 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-a0c5c502-3604-43d8-b90b-42fea5ebffb0 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d380efbe8c44fb3bbc58c9913cb25e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd0ea68fb8a43e886d0c9722d766ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:12.551179 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-a0c5c502-3604-43d8-b90b-42fea5ebffb0 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] 10.222.0.41 "GET /compute/v2.1/servers/d3b264dc-45ea-4e2f-8e62-42f1b7424d50" status: 200 len: 1218 microversion: 2.1 time: 0.551335 May 26 12:46:12.558867 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 7/17] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:46:11 2022] GET /compute/v2.1/servers/d3b264dc-45ea-4e2f-8e62-42f1b7424d50 => generated 1218 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:46:13.457903 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-04df4595-7ed3-4582-a76a-0faca3b5c00f tempest-VolumesSnapshotsTestJSON-2055236343 tempest-VolumesSnapshotsTestJSON-2055236343-project] Calling method '.version_select at 0x7f26a3d19b80>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:13.550396 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-04df4595-7ed3-4582-a76a-0faca3b5c00f tempest-VolumesSnapshotsTestJSON-2055236343 tempest-VolumesSnapshotsTestJSON-2055236343-project] 10.222.0.41 "GET /compute/v2.1/os-snapshots/feaeecf1-a39d-4a1f-a296-c78a578617d2" status: 200 len: 287 microversion: 2.1 time: 0.104963 May 26 12:46:13.551003 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 11/18] 10.222.0.41 () {58 vars in 1250 bytes} [Thu May 26 12:46:13 2022] GET /compute/v2.1/os-snapshots/feaeecf1-a39d-4a1f-a296-c78a578617d2 => generated 287 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:46:13.563559 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-3146c95d-1d00-4631-a5c9-f6f2623ce7d2 tempest-VolumesSnapshotsTestJSON-2055236343 tempest-VolumesSnapshotsTestJSON-2055236343-project] Calling method '.version_select at 0x7f26a2b254c0>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:13.580687 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-12daee45-d29e-470c-bd7a-8d8fe3b4bc6f tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:13.581880 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-12daee45-d29e-470c-bd7a-8d8fe3b4bc6f tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] [instance: d3b264dc-45ea-4e2f-8e62-42f1b7424d50] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:13.614353 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-12daee45-d29e-470c-bd7a-8d8fe3b4bc6f tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:13.616989 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-12daee45-d29e-470c-bd7a-8d8fe3b4bc6f tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:13.620112 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-12daee45-d29e-470c-bd7a-8d8fe3b4bc6f tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:13.622504 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-12daee45-d29e-470c-bd7a-8d8fe3b4bc6f tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:13.825995 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-3146c95d-1d00-4631-a5c9-f6f2623ce7d2 tempest-VolumesSnapshotsTestJSON-2055236343 tempest-VolumesSnapshotsTestJSON-2055236343-project] 10.222.0.41 "DELETE /compute/v2.1/os-snapshots/feaeecf1-a39d-4a1f-a296-c78a578617d2" status: 202 len: 0 microversion: 2.1 time: 0.267016 May 26 12:46:13.826704 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 8/19] 10.222.0.41 () {58 vars in 1253 bytes} [Thu May 26 12:46:13 2022] DELETE /compute/v2.1/os-snapshots/feaeecf1-a39d-4a1f-a296-c78a578617d2 => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 12:46:13.832470 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-dc936177-f1ad-4e15-aff6-5b77006222af tempest-VolumesTestJSON-913756250 tempest-VolumesTestJSON-913756250-project] Calling method '.version_select at 0x7f26a2b259d0>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:13.975483 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-dc936177-f1ad-4e15-aff6-5b77006222af tempest-VolumesTestJSON-913756250 tempest-VolumesTestJSON-913756250-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/21471bb6-6f72-4fa5-92dd-615d0ba275d3" status: 200 len: 350 microversion: 2.1 time: 0.146648 May 26 12:46:13.977365 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 9/20] 10.222.0.41 () {58 vars in 1244 bytes} [Thu May 26 12:46:13 2022] GET /compute/v2.1/os-volumes/21471bb6-6f72-4fa5-92dd-615d0ba275d3 => generated 350 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:46:13.985703 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-f9607484-7088-48e6-977b-5a52210b028d tempest-VolumesSnapshotsTestJSON-2055236343 tempest-VolumesSnapshotsTestJSON-2055236343-project] Calling method '.version_select at 0x7f26a2b25790>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:14.035481 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-f9607484-7088-48e6-977b-5a52210b028d tempest-VolumesSnapshotsTestJSON-2055236343 tempest-VolumesSnapshotsTestJSON-2055236343-project] 10.222.0.41 "GET /compute/v2.1/os-snapshots/feaeecf1-a39d-4a1f-a296-c78a578617d2" status: 200 len: 286 microversion: 2.1 time: 0.056037 May 26 12:46:14.036270 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 10/21] 10.222.0.41 () {58 vars in 1250 bytes} [Thu May 26 12:46:13 2022] GET /compute/v2.1/os-snapshots/feaeecf1-a39d-4a1f-a296-c78a578617d2 => generated 286 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:46:14.387508 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-12daee45-d29e-470c-bd7a-8d8fe3b4bc6f tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d380efbe8c44fb3bbc58c9913cb25e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd0ea68fb8a43e886d0c9722d766ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:14.417210 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-12daee45-d29e-470c-bd7a-8d8fe3b4bc6f tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] 10.222.0.41 "GET /compute/v2.1/servers/d3b264dc-45ea-4e2f-8e62-42f1b7424d50" status: 200 len: 1218 microversion: 2.1 time: 0.835421 May 26 12:46:14.418317 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 12/22] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:46:13 2022] GET /compute/v2.1/servers/d3b264dc-45ea-4e2f-8e62-42f1b7424d50 => generated 1218 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:46:15.048444 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-a7de9db6-086a-4f62-9831-f98414f0950f tempest-VolumesSnapshotsTestJSON-2055236343 tempest-VolumesSnapshotsTestJSON-2055236343-project] Calling method '.version_select at 0x7f26a2ba0ee0>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:15.116445 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-a7de9db6-086a-4f62-9831-f98414f0950f tempest-VolumesSnapshotsTestJSON-2055236343 tempest-VolumesSnapshotsTestJSON-2055236343-project] 10.222.0.41 "GET /compute/v2.1/os-snapshots/feaeecf1-a39d-4a1f-a296-c78a578617d2" status: 200 len: 286 microversion: 2.1 time: 0.071786 May 26 12:46:15.118009 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 11/23] 10.222.0.41 () {58 vars in 1250 bytes} [Thu May 26 12:46:15 2022] GET /compute/v2.1/os-snapshots/feaeecf1-a39d-4a1f-a296-c78a578617d2 => generated 286 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:46:15.454924 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-27505c24-c5be-4086-8b1c-2cd59c92f7a4 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:15.463877 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-27505c24-c5be-4086-8b1c-2cd59c92f7a4 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] [instance: d3b264dc-45ea-4e2f-8e62-42f1b7424d50] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:15.512451 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-27505c24-c5be-4086-8b1c-2cd59c92f7a4 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:15.512451 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-27505c24-c5be-4086-8b1c-2cd59c92f7a4 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:15.518044 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-27505c24-c5be-4086-8b1c-2cd59c92f7a4 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:15.518888 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-27505c24-c5be-4086-8b1c-2cd59c92f7a4 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:15.768012 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-27505c24-c5be-4086-8b1c-2cd59c92f7a4 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d380efbe8c44fb3bbc58c9913cb25e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd0ea68fb8a43e886d0c9722d766ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:15.791376 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-27505c24-c5be-4086-8b1c-2cd59c92f7a4 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] 10.222.0.41 "GET /compute/v2.1/servers/d3b264dc-45ea-4e2f-8e62-42f1b7424d50" status: 200 len: 1210 microversion: 2.1 time: 0.357923 May 26 12:46:15.792334 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 13/24] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:46:15 2022] GET /compute/v2.1/servers/d3b264dc-45ea-4e2f-8e62-42f1b7424d50 => generated 1210 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:46:15.949464 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-29f1342e-f6bf-4c8d-8f8d-4009df1dce62 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-106807083", "imageRef": "6df25342-b071-489b-a7c1-3089fa19af6d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:46:16.082683 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.network.neutron [None req-29f1342e-f6bf-4c8d-8f8d-4009df1dce62 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] validate_networks() for [('a5fd1140-8cda-4630-8a6d-7a85bf14faa2', None, None, None, None, None)] {{(pid=124824) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 12:46:16.134576 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-ab9c1a13-9ed0-4cf2-b0a4-ec0702176712 tempest-VolumesSnapshotsTestJSON-2055236343 tempest-VolumesSnapshotsTestJSON-2055236343-project] Calling method '.version_select at 0x7f26a3c1e790>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:16.201810 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-ab9c1a13-9ed0-4cf2-b0a4-ec0702176712 tempest-VolumesSnapshotsTestJSON-2055236343 tempest-VolumesSnapshotsTestJSON-2055236343-project] 10.222.0.41 "GET /compute/v2.1/os-snapshots/feaeecf1-a39d-4a1f-a296-c78a578617d2" status: 200 len: 286 microversion: 2.1 time: 0.071932 May 26 12:46:16.202886 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 14/25] 10.222.0.41 () {58 vars in 1250 bytes} [Thu May 26 12:46:16 2022] GET /compute/v2.1/os-snapshots/feaeecf1-a39d-4a1f-a296-c78a578617d2 => generated 286 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:46:16.913491 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-2e632650-2118-46da-b9d8-835a4099e5c7 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Action: 'create', calling method: .version_select at 0x7f26a3c7eaf0>, body: {"keypair": {"name": "tempest-keypair-113748839", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFjTrU0Y/IuhgVfBPeDCgaua3JMIQeH0Mm5XJGCwDMPgenSZoUj7Sr2Qi2gy7MbeU+pwe1FiC6xcYGAnfqKMGOESKorLAcbfq13YBixQsajG5thXvcGvZJ1peYndVHjkJQ=="}} {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:46:17.108361 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.quota [None req-2e632650-2118-46da-b9d8-835a4099e5c7 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Getting quotas for project cad768b45d17480d8d6bbbcff6032c8d. Resources: {'key_pairs'} {{(pid=124823) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:46:17.124810 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.quota [None req-2e632650-2118-46da-b9d8-835a4099e5c7 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Getting quotas for user 0537911b91184fcdbdcc9e93ec3fe5b9 and project cad768b45d17480d8d6bbbcff6032c8d. Resources: {'key_pairs'} {{(pid=124823) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:46:17.343483 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-2e632650-2118-46da-b9d8-835a4099e5c7 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.601683 May 26 12:46:17.344624 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 15/26] 10.222.0.41 () {60 vars in 1158 bytes} [Thu May 26 12:46:16 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:46:17.349983 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-66903c13-ff74-491b-81ee-d1103223085f tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:17.361036 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-66903c13-ff74-491b-81ee-d1103223085f tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] [instance: d3b264dc-45ea-4e2f-8e62-42f1b7424d50] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:17.380345 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-66903c13-ff74-491b-81ee-d1103223085f tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:17.380666 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.virt.hardware [None req-29f1342e-f6bf-4c8d-8f8d-4009df1dce62 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Flavor limits 0:0:0 {{(pid=124824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 12:46:17.381444 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-66903c13-ff74-491b-81ee-d1103223085f tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:17.381856 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.virt.hardware [None req-29f1342e-f6bf-4c8d-8f8d-4009df1dce62 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Image limits 0:0:0 {{(pid=124824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 12:46:17.382549 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.virt.hardware [None req-29f1342e-f6bf-4c8d-8f8d-4009df1dce62 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Flavor pref 0:0:0 {{(pid=124824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 12:46:17.383690 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.virt.hardware [None req-29f1342e-f6bf-4c8d-8f8d-4009df1dce62 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Image pref 0:0:0 {{(pid=124824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 12:46:17.384085 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-66903c13-ff74-491b-81ee-d1103223085f tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:17.384449 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.virt.hardware [None req-29f1342e-f6bf-4c8d-8f8d-4009df1dce62 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 12:46:17.389550 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-66903c13-ff74-491b-81ee-d1103223085f tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:17.396727 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-29f1342e-f6bf-4c8d-8f8d-4009df1dce62 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:17.400370 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-29f1342e-f6bf-4c8d-8f8d-4009df1dce62 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:17.402760 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-29f1342e-f6bf-4c8d-8f8d-4009df1dce62 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:17.404562 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-29f1342e-f6bf-4c8d-8f8d-4009df1dce62 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:17.466864 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.quota [None req-29f1342e-f6bf-4c8d-8f8d-4009df1dce62 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Getting quotas for project 9930a0f4448d4ef0a6030da17a36257a. Resources: {'instances', 'ram', 'cores'} {{(pid=124824) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:46:17.475271 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.quota [None req-29f1342e-f6bf-4c8d-8f8d-4009df1dce62 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Getting quotas for user cf98a4d33cab49b08640f437dbfb2dc8 and project 9930a0f4448d4ef0a6030da17a36257a. Resources: {'instances', 'ram', 'cores'} {{(pid=124824) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:46:17.503955 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-29f1342e-f6bf-4c8d-8f8d-4009df1dce62 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Going to run 1 instances... {{(pid=124824) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 12:46:17.506978 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-29f1342e-f6bf-4c8d-8f8d-4009df1dce62 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6df25342-b071-489b-a7c1-3089fa19af6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124824) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 12:46:17.716429 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-29f1342e-f6bf-4c8d-8f8d-4009df1dce62 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.064975 May 26 12:46:17.719015 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 12/27] 10.222.0.41 () {60 vars in 1146 bytes} [Thu May 26 12:46:15 2022] POST /compute/v2.1/servers => generated 383 bytes in 2070 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 12:46:17.745925 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-62f90dee-bba1-43df-9f7e-8ebf62b153a2 tempest-VolumesSnapshotsTestJSON-2055236343 tempest-VolumesSnapshotsTestJSON-2055236343-project] Calling method '.version_select at 0x7f26a2ba0dc0>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:17.880566 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.wsgi [None req-62f90dee-bba1-43df-9f7e-8ebf62b153a2 tempest-VolumesSnapshotsTestJSON-2055236343 tempest-VolumesSnapshotsTestJSON-2055236343-project] HTTP exception thrown: Snapshot feaeecf1-a39d-4a1f-a296-c78a578617d2 could not be found. May 26 12:46:17.885973 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-62f90dee-bba1-43df-9f7e-8ebf62b153a2 tempest-VolumesSnapshotsTestJSON-2055236343 tempest-VolumesSnapshotsTestJSON-2055236343-project] Request method failure captured: May 26 12:46:17.885973 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: request: GET /compute/v2.1/os-snapshots/feaeecf1-a39d-4a1f-a296-c78a578617d2 HTTP/1.1 May 26 12:46:17.885973 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Accept: application/json May 26 12:46:17.885973 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Accept-Encoding: identity May 26 12:46:17.885973 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Connection: close May 26 12:46:17.885973 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Content-Length: 0 May 26 12:46:17.885973 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Content-Type: application/json May 26 12:46:17.885973 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Host: 10.222.0.41 May 26 12:46:17.885973 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Openstack-System-Scope: None May 26 12:46:17.885973 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: User-Agent: python-urllib3/1.26.9 May 26 12:46:17.885973 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Auth-Token: gAAAAABij3aJ6g5IoNxOEO-6RXpLhzi37ak_1VCrVEl83o5yr3jfLLbPj5OejaVZpkG9LLfzZPR1881yacCC1JRG9akKb3vHRR2cAmakhEbIU_fTBZlv2HME2_ABCS9Va1vmREct-lQoVuD1UWjNsW8-Alei9rc6fLsiFqU0fVmOGLmGYf4L9dE May 26 12:46:17.885973 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Domain-Id: None May 26 12:46:17.885973 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Domain-Name: None May 26 12:46:17.885973 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Identity-Status: Confirmed May 26 12:46:17.885973 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Is-Admin-Project: True May 26 12:46:17.885973 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Domain-Id: default May 26 12:46:17.885973 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Domain-Name: Default May 26 12:46:17.885973 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Id: fae36bb3997f4f14b8f1a0bcaf0fca1a May 26 12:46:17.885973 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2055236343 May 26 12:46:17.885973 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Role: member,reader May 26 12:46:17.885973 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Roles: member,reader May 26 12:46:17.887206 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/fae36bb3997f4f14b8f1a0bcaf0fca1a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/fae36bb3997f4f14b8f1a0bcaf0fca1a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/fae36bb3997f4f14b8f1a0bcaf0fca1a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_fae36bb3997f4f14b8f1a0bcaf0fca1a", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 26 12:46:17.887206 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2055236343 May 26 12:46:17.887206 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Tenant-Id: fae36bb3997f4f14b8f1a0bcaf0fca1a May 26 12:46:17.887206 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2055236343 May 26 12:46:17.887206 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User: tempest-VolumesSnapshotsTestJSON-2055236343-project May 26 12:46:17.887206 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Domain-Id: default May 26 12:46:17.887206 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Domain-Name: Default May 26 12:46:17.887206 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Id: d1a4623e202d4d359037fb958a4e1e7c May 26 12:46:17.887206 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2055236343-project May 26 12:46:17.887206 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: method: May 26 12:46:17.887206 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: exception: Snapshot feaeecf1-a39d-4a1f-a296-c78a578617d2 could not be found. May 26 12:46:17.887206 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: action_args: {'id': 'feaeecf1-a39d-4a1f-a296-c78a578617d2'} May 26 12:46:17.887206 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:46:17.887957 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:46:17.887957 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 26 12:46:17.887957 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 26 12:46:17.887957 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 26 12:46:17.887957 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 26 12:46:17.887957 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 26 12:46:17.887957 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 26 12:46:17.887957 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 12:46:17.887957 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 12:46:17.887957 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 12:46:17.887957 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 12:46:17.887957 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 12:46:17.887957 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 12:46:17.887957 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 12:46:17.887957 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 12:46:17.887957 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot feaeecf1-a39d-4a1f-a296-c78a578617d2 could not be found. (HTTP 404) (Request-ID: req-be44c62e-b7be-44fd-970f-b1f9d4eef77f) May 26 12:46:17.887957 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:46:17.887957 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:46:17.889184 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:46:17.889184 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:46:17.889184 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 26 12:46:17.889184 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 26 12:46:17.889184 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 12:46:17.889184 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 12:46:17.889184 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 26 12:46:17.889184 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 26 12:46:17.889184 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 12:46:17.889184 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 12:46:17.889184 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 26 12:46:17.889184 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 26 12:46:17.889184 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 26 12:46:17.889184 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 26 12:46:17.889184 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 26 12:46:17.889184 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 26 12:46:17.889184 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 12:46:17.889184 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 12:46:17.889184 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 12:46:17.890266 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 12:46:17.890266 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 12:46:17.890266 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 12:46:17.890266 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 12:46:17.890266 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 12:46:17.890266 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot feaeecf1-a39d-4a1f-a296-c78a578617d2 could not be found. May 26 12:46:17.890266 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:46:17.890266 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:46:17.890266 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:46:17.890266 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:46:17.890266 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:46:17.890266 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:46:17.890266 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:46:17.890266 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:46:17.890266 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 12:46:17.890266 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 12:46:17.890266 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:46:17.890266 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:46:17.890266 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 26 12:46:17.890266 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:46:17.891275 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot feaeecf1-a39d-4a1f-a296-c78a578617d2 could not be found. May 26 12:46:17.891275 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:46:17.891275 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:46:17.891275 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:46:17.891275 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:46:17.891275 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:46:17.891275 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:46:17.891275 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:46:17.891275 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:46:17.891275 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot feaeecf1-a39d-4a1f-a296-c78a578617d2 could not be found. May 26 12:46:17.891275 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:46:17.892756 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-62f90dee-bba1-43df-9f7e-8ebf62b153a2 tempest-VolumesSnapshotsTestJSON-2055236343 tempest-VolumesSnapshotsTestJSON-2055236343-project] Returning 404 to user: Snapshot feaeecf1-a39d-4a1f-a296-c78a578617d2 could not be found. {{(pid=124824) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:46:17.893847 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-62f90dee-bba1-43df-9f7e-8ebf62b153a2 tempest-VolumesSnapshotsTestJSON-2055236343 tempest-VolumesSnapshotsTestJSON-2055236343-project] 10.222.0.41 "GET /compute/v2.1/os-snapshots/feaeecf1-a39d-4a1f-a296-c78a578617d2" status: 404 len: 111 microversion: 2.1 time: 0.173696 May 26 12:46:17.894585 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 13/28] 10.222.0.41 () {58 vars in 1250 bytes} [Thu May 26 12:46:17 2022] GET /compute/v2.1/os-snapshots/feaeecf1-a39d-4a1f-a296-c78a578617d2 => generated 111 bytes in 175 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:46:17.910642 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-74e9eb2e-873f-4896-b817-24010c9d6972 tempest-VolumesTestJSON-913756250 tempest-VolumesTestJSON-913756250-project] Calling method '.version_select at 0x7f26a2b3d040>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:18.014672 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-74e9eb2e-873f-4896-b817-24010c9d6972 tempest-VolumesTestJSON-913756250 tempest-VolumesTestJSON-913756250-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/29e1dd6d-34be-4f2f-8d45-d8028a49e688" status: 200 len: 351 microversion: 2.1 time: 0.108732 May 26 12:46:18.015573 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 14/29] 10.222.0.41 () {58 vars in 1244 bytes} [Thu May 26 12:46:17 2022] GET /compute/v2.1/os-volumes/29e1dd6d-34be-4f2f-8d45-d8028a49e688 => generated 351 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:46:18.021595 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-fdaa2a41-abf8-44eb-ad0f-29fd34d39bdd tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:18.025702 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-fdaa2a41-abf8-44eb-ad0f-29fd34d39bdd tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:18.042816 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-66903c13-ff74-491b-81ee-d1103223085f tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d380efbe8c44fb3bbc58c9913cb25e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd0ea68fb8a43e886d0c9722d766ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:18.051876 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-66903c13-ff74-491b-81ee-d1103223085f tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] 10.222.0.41 "GET /compute/v2.1/servers/d3b264dc-45ea-4e2f-8e62-42f1b7424d50" status: 200 len: 1266 microversion: 2.1 time: 0.705933 May 26 12:46:18.061153 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 16/30] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:46:17 2022] GET /compute/v2.1/servers/d3b264dc-45ea-4e2f-8e62-42f1b7424d50 => generated 1266 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:46:18.068642 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-488af6bd-0300-42df-b527-303804a97f31 tempest-VolumesSnapshotsTestJSON-2055236343 tempest-VolumesSnapshotsTestJSON-2055236343-project] Calling method '.version_select at 0x7f26a33729d0>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:18.255956 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-fdaa2a41-abf8-44eb-ad0f-29fd34d39bdd tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:18.267277 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-fdaa2a41-abf8-44eb-ad0f-29fd34d39bdd tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a" status: 200 len: 1221 microversion: 2.1 time: 0.249897 May 26 12:46:18.270590 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 15/31] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:46:18 2022] GET /compute/v2.1/servers/c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a => generated 1221 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:46:18.280435 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-cc98c5f0-6993-4385-b89b-1ceeab4a37da tempest-VolumesTestJSON-913756250 tempest-VolumesTestJSON-913756250-project] Calling method '.version_select at 0x7f26a2aac4c0>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:18.444566 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-488af6bd-0300-42df-b527-303804a97f31 tempest-VolumesSnapshotsTestJSON-2055236343 tempest-VolumesSnapshotsTestJSON-2055236343-project] 10.222.0.41 "DELETE /compute/v2.1/os-volumes/fb31eb60-d419-4a58-b735-c01e5dceda03" status: 202 len: 0 microversion: 2.1 time: 0.379676 May 26 12:46:18.446598 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 17/32] 10.222.0.41 () {58 vars in 1247 bytes} [Thu May 26 12:46:18 2022] DELETE /compute/v2.1/os-volumes/fb31eb60-d419-4a58-b735-c01e5dceda03 => generated 0 bytes in 385 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 12:46:18.459335 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-40f0e2aa-b058-44cb-bc80-a0c09eae4f19 tempest-VolumesSnapshotsTestJSON-2055236343 tempest-VolumesSnapshotsTestJSON-2055236343-project] Calling method '.version_select at 0x7f26a3372790>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:18.481462 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-cc98c5f0-6993-4385-b89b-1ceeab4a37da tempest-VolumesTestJSON-913756250 tempest-VolumesTestJSON-913756250-project] 10.222.0.41 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.209247 May 26 12:46:18.482876 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 16/33] 10.222.0.41 () {58 vars in 1133 bytes} [Thu May 26 12:46:18 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:46:18.490774 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-116352da-672d-4bda-b817-5ecea073e3c9 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-805708835", "imageRef": "6df25342-b071-489b-a7c1-3089fa19af6d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:46:18.643238 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.network.neutron [None req-116352da-672d-4bda-b817-5ecea073e3c9 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] validate_networks() for [('a5fd1140-8cda-4630-8a6d-7a85bf14faa2', None, None, None, None, None)] {{(pid=124824) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 12:46:18.660655 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-40f0e2aa-b058-44cb-bc80-a0c09eae4f19 tempest-VolumesSnapshotsTestJSON-2055236343 tempest-VolumesSnapshotsTestJSON-2055236343-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/fb31eb60-d419-4a58-b735-c01e5dceda03" status: 200 len: 344 microversion: 2.1 time: 0.206831 May 26 12:46:18.661595 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 18/34] 10.222.0.41 () {58 vars in 1244 bytes} [Thu May 26 12:46:18 2022] GET /compute/v2.1/os-volumes/fb31eb60-d419-4a58-b735-c01e5dceda03 => generated 344 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:46:18.697132 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-30d87256-3fbf-40bb-be25-903c0717b86f tempest-VolumesTestJSON-913756250 tempest-VolumesTestJSON-913756250-project] Calling method '.version_select at 0x7f26a337b820>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:18.897640 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-30d87256-3fbf-40bb-be25-903c0717b86f tempest-VolumesTestJSON-913756250 tempest-VolumesTestJSON-913756250-project] 10.222.0.41 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.234385 May 26 12:46:18.905841 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 19/35] 10.222.0.41 () {58 vars in 1148 bytes} [Thu May 26 12:46:18 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:46:18.921012 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-94e3d110-d225-4357-a92b-05549e146fe8 tempest-VolumesTestJSON-913756250 tempest-VolumesTestJSON-913756250-project] Calling method '.version_select at 0x7f26a3372670>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:19.160117 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-94e3d110-d225-4357-a92b-05549e146fe8 tempest-VolumesTestJSON-913756250 tempest-VolumesTestJSON-913756250-project] 10.222.0.41 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.244035 May 26 12:46:19.161372 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 20/36] 10.222.0.41 () {58 vars in 1133 bytes} [Thu May 26 12:46:18 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:46:19.176126 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-da7b4d8e-16e9-4790-b4a8-817643fd08d9 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:19.176815 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-da7b4d8e-16e9-4790-b4a8-817643fd08d9 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] [instance: d3b264dc-45ea-4e2f-8e62-42f1b7424d50] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:19.205804 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-da7b4d8e-16e9-4790-b4a8-817643fd08d9 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:19.206441 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-da7b4d8e-16e9-4790-b4a8-817643fd08d9 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:19.207269 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-da7b4d8e-16e9-4790-b4a8-817643fd08d9 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:19.207706 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-da7b4d8e-16e9-4790-b4a8-817643fd08d9 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:19.425381 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-da7b4d8e-16e9-4790-b4a8-817643fd08d9 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d380efbe8c44fb3bbc58c9913cb25e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd0ea68fb8a43e886d0c9722d766ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:19.438998 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-da7b4d8e-16e9-4790-b4a8-817643fd08d9 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] 10.222.0.41 "GET /compute/v2.1/servers/d3b264dc-45ea-4e2f-8e62-42f1b7424d50" status: 200 len: 1272 microversion: 2.1 time: 0.269028 May 26 12:46:19.439971 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 21/37] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:46:19 2022] GET /compute/v2.1/servers/d3b264dc-45ea-4e2f-8e62-42f1b7424d50 => generated 1272 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:46:19.457698 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-a0447b8d-3e16-4ed5-b52b-2960e3bf3ef7 tempest-VolumesTestJSON-913756250 tempest-VolumesTestJSON-913756250-project] Calling method '.version_select at 0x7f26a337b1f0>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:19.677159 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-a0447b8d-3e16-4ed5-b52b-2960e3bf3ef7 tempest-VolumesTestJSON-913756250 tempest-VolumesTestJSON-913756250-project] 10.222.0.41 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.235611 May 26 12:46:19.685519 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 22/38] 10.222.0.41 () {58 vars in 1166 bytes} [Thu May 26 12:46:19 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:46:19.690784 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-f5c53481-8819-4833-bfe1-b12284ed42a7 tempest-VolumesSnapshotsTestJSON-2055236343 tempest-VolumesSnapshotsTestJSON-2055236343-project] Calling method '.version_select at 0x7f26a330fb80>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:19.842759 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.wsgi [None req-f5c53481-8819-4833-bfe1-b12284ed42a7 tempest-VolumesSnapshotsTestJSON-2055236343 tempest-VolumesSnapshotsTestJSON-2055236343-project] HTTP exception thrown: Volume fb31eb60-d419-4a58-b735-c01e5dceda03 could not be found. May 26 12:46:19.846934 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-f5c53481-8819-4833-bfe1-b12284ed42a7 tempest-VolumesSnapshotsTestJSON-2055236343 tempest-VolumesSnapshotsTestJSON-2055236343-project] Request method failure captured: May 26 12:46:19.846934 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: request: GET /compute/v2.1/os-volumes/fb31eb60-d419-4a58-b735-c01e5dceda03 HTTP/1.1 May 26 12:46:19.846934 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Accept: application/json May 26 12:46:19.846934 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Accept-Encoding: identity May 26 12:46:19.846934 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Connection: close May 26 12:46:19.846934 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Content-Length: 0 May 26 12:46:19.846934 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Content-Type: application/json May 26 12:46:19.846934 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Host: 10.222.0.41 May 26 12:46:19.846934 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Openstack-System-Scope: None May 26 12:46:19.846934 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: User-Agent: python-urllib3/1.26.9 May 26 12:46:19.846934 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Auth-Token: gAAAAABij3aJ6g5IoNxOEO-6RXpLhzi37ak_1VCrVEl83o5yr3jfLLbPj5OejaVZpkG9LLfzZPR1881yacCC1JRG9akKb3vHRR2cAmakhEbIU_fTBZlv2HME2_ABCS9Va1vmREct-lQoVuD1UWjNsW8-Alei9rc6fLsiFqU0fVmOGLmGYf4L9dE May 26 12:46:19.846934 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Domain-Id: None May 26 12:46:19.846934 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Domain-Name: None May 26 12:46:19.846934 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Identity-Status: Confirmed May 26 12:46:19.846934 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Is-Admin-Project: True May 26 12:46:19.846934 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Project-Domain-Id: default May 26 12:46:19.846934 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Project-Domain-Name: Default May 26 12:46:19.846934 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Project-Id: fae36bb3997f4f14b8f1a0bcaf0fca1a May 26 12:46:19.846934 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2055236343 May 26 12:46:19.846934 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Role: member,reader May 26 12:46:19.846934 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Roles: member,reader May 26 12:46:19.848272 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/fae36bb3997f4f14b8f1a0bcaf0fca1a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/fae36bb3997f4f14b8f1a0bcaf0fca1a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/fae36bb3997f4f14b8f1a0bcaf0fca1a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_fae36bb3997f4f14b8f1a0bcaf0fca1a", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 26 12:46:19.848272 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2055236343 May 26 12:46:19.848272 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Tenant-Id: fae36bb3997f4f14b8f1a0bcaf0fca1a May 26 12:46:19.848272 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2055236343 May 26 12:46:19.848272 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User: tempest-VolumesSnapshotsTestJSON-2055236343-project May 26 12:46:19.848272 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User-Domain-Id: default May 26 12:46:19.848272 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User-Domain-Name: Default May 26 12:46:19.848272 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User-Id: d1a4623e202d4d359037fb958a4e1e7c May 26 12:46:19.848272 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2055236343-project May 26 12:46:19.848272 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: method: May 26 12:46:19.848272 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: exception: Volume fb31eb60-d419-4a58-b735-c01e5dceda03 could not be found. May 26 12:46:19.848272 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: action_args: {'id': 'fb31eb60-d419-4a58-b735-c01e5dceda03'} May 26 12:46:19.848272 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:46:19.849022 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:46:19.849022 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 12:46:19.849022 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 12:46:19.849022 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 12:46:19.849022 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 12:46:19.849022 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 12:46:19.849022 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 12:46:19.849022 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 12:46:19.849022 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 12:46:19.849022 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 12:46:19.849022 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 12:46:19.849022 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 12:46:19.849022 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 12:46:19.849022 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 12:46:19.849022 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 12:46:19.849022 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume fb31eb60-d419-4a58-b735-c01e5dceda03 could not be found. (HTTP 404) (Request-ID: req-9d122c09-f324-4011-b48f-768f1ff753cf) May 26 12:46:19.849022 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:46:19.849022 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:46:19.849022 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:46:19.850121 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:46:19.850121 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 26 12:46:19.850121 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 26 12:46:19.850121 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 12:46:19.850121 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 12:46:19.850121 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 12:46:19.850121 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 12:46:19.850121 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 12:46:19.850121 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 12:46:19.850121 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 12:46:19.850121 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 12:46:19.850121 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 12:46:19.850121 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 12:46:19.850121 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 12:46:19.850121 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 12:46:19.850121 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 12:46:19.850121 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 12:46:19.850121 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 12:46:19.850121 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 12:46:19.851542 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 12:46:19.851542 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 12:46:19.851542 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 12:46:19.851542 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 12:46:19.851542 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume fb31eb60-d419-4a58-b735-c01e5dceda03 could not be found. May 26 12:46:19.851542 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:46:19.851542 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:46:19.851542 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:46:19.851542 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:46:19.851542 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:46:19.851542 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:46:19.851542 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:46:19.851542 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:46:19.851542 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 12:46:19.851542 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 12:46:19.851542 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:46:19.851542 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:46:19.851542 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 26 12:46:19.851542 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:46:19.851542 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume fb31eb60-d419-4a58-b735-c01e5dceda03 could not be found. May 26 12:46:19.853191 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:46:19.853191 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:46:19.853191 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:46:19.853191 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:46:19.853191 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:46:19.853191 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:46:19.853191 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:46:19.853191 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:46:19.853191 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume fb31eb60-d419-4a58-b735-c01e5dceda03 could not be found. May 26 12:46:19.853191 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:46:19.853191 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-f5c53481-8819-4833-bfe1-b12284ed42a7 tempest-VolumesSnapshotsTestJSON-2055236343 tempest-VolumesSnapshotsTestJSON-2055236343-project] Returning 404 to user: Volume fb31eb60-d419-4a58-b735-c01e5dceda03 could not be found. {{(pid=124823) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:46:19.853191 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-f5c53481-8819-4833-bfe1-b12284ed42a7 tempest-VolumesSnapshotsTestJSON-2055236343 tempest-VolumesSnapshotsTestJSON-2055236343-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/fb31eb60-d419-4a58-b735-c01e5dceda03" status: 404 len: 109 microversion: 2.1 time: 0.162013 May 26 12:46:19.867142 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 23/39] 10.222.0.41 () {58 vars in 1244 bytes} [Thu May 26 12:46:19 2022] GET /compute/v2.1/os-volumes/fb31eb60-d419-4a58-b735-c01e5dceda03 => generated 109 bytes in 181 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:46:19.874921 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-96c79f55-48bf-4cd5-a541-ad05c21b961a tempest-VolumesTestJSON-913756250 tempest-VolumesTestJSON-913756250-project] Calling method '.version_select at 0x7f26a330f430>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:20.128721 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-96c79f55-48bf-4cd5-a541-ad05c21b961a tempest-VolumesTestJSON-913756250 tempest-VolumesTestJSON-913756250-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.257559 May 26 12:46:20.129265 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 24/40] 10.222.0.41 () {58 vars in 1169 bytes} [Thu May 26 12:46:19 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:46:20.509788 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.virt.hardware [None req-116352da-672d-4bda-b817-5ecea073e3c9 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Flavor limits 0:0:0 {{(pid=124824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 12:46:20.510297 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.virt.hardware [None req-116352da-672d-4bda-b817-5ecea073e3c9 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Image limits 0:0:0 {{(pid=124824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 12:46:20.513887 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.virt.hardware [None req-116352da-672d-4bda-b817-5ecea073e3c9 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Flavor pref 0:0:0 {{(pid=124824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 12:46:20.513887 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.virt.hardware [None req-116352da-672d-4bda-b817-5ecea073e3c9 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Image pref 0:0:0 {{(pid=124824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 12:46:20.513887 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.virt.hardware [None req-116352da-672d-4bda-b817-5ecea073e3c9 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 12:46:20.533718 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-116352da-672d-4bda-b817-5ecea073e3c9 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:20.534169 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-116352da-672d-4bda-b817-5ecea073e3c9 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:20.535018 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-116352da-672d-4bda-b817-5ecea073e3c9 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:20.536222 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-116352da-672d-4bda-b817-5ecea073e3c9 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:20.618828 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.quota [None req-116352da-672d-4bda-b817-5ecea073e3c9 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Getting quotas for project 9930a0f4448d4ef0a6030da17a36257a. Resources: {'instances', 'ram', 'cores'} {{(pid=124824) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:46:20.632479 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.quota [None req-116352da-672d-4bda-b817-5ecea073e3c9 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Getting quotas for user cf98a4d33cab49b08640f437dbfb2dc8 and project 9930a0f4448d4ef0a6030da17a36257a. Resources: {'instances', 'ram', 'cores'} {{(pid=124824) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:46:20.711086 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-116352da-672d-4bda-b817-5ecea073e3c9 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Going to run 1 instances... {{(pid=124824) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 12:46:20.727791 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-116352da-672d-4bda-b817-5ecea073e3c9 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: a442ae3a-5311-4f8f-acf3-08ce1534c9ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6df25342-b071-489b-a7c1-3089fa19af6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124824) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 12:46:21.080689 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-116352da-672d-4bda-b817-5ecea073e3c9 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.591944 May 26 12:46:21.090692 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 17/41] 10.222.0.41 () {60 vars in 1146 bytes} [Thu May 26 12:46:18 2022] POST /compute/v2.1/servers => generated 383 bytes in 2607 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 12:46:21.141990 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-a472fd1a-e835-4bc7-9e23-0dbad370b597 tempest-VolumesSnapshotsTestJSON-2055236343 tempest-VolumesSnapshotsTestJSON-2055236343-project] Calling method '.version_select at 0x7f26a2aac550>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:21.253411 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-d9659127-83fd-4162-9d92-565d9f6c54d3 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Action: 'create', calling method: .version_select at 0x7f26a33725e0>, body: {"keypair": {"name": "tempest-keypair-186672759", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAEoFofakNMmYkvqCljDQhc/mNYBKCmq22av9wwFaN/R1WHYuJiaW/E8zXEZ1lzzkOmAEFyyayBLQsMttpSKFH97RIavFWB/jIeseBAq7iCDq6JFFO5FKrNpNF7WL7qWlQ=="}} {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:46:21.286757 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.wsgi [None req-a472fd1a-e835-4bc7-9e23-0dbad370b597 tempest-VolumesSnapshotsTestJSON-2055236343 tempest-VolumesSnapshotsTestJSON-2055236343-project] HTTP exception thrown: Volume fb31eb60-d419-4a58-b735-c01e5dceda03 could not be found. May 26 12:46:21.290972 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-a472fd1a-e835-4bc7-9e23-0dbad370b597 tempest-VolumesSnapshotsTestJSON-2055236343 tempest-VolumesSnapshotsTestJSON-2055236343-project] Request method failure captured: May 26 12:46:21.290972 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: request: DELETE /compute/v2.1/os-volumes/fb31eb60-d419-4a58-b735-c01e5dceda03 HTTP/1.1 May 26 12:46:21.290972 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Accept: application/json May 26 12:46:21.290972 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Accept-Encoding: identity May 26 12:46:21.290972 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Connection: close May 26 12:46:21.290972 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Content-Length: 0 May 26 12:46:21.290972 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Content-Type: application/json May 26 12:46:21.290972 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Host: 10.222.0.41 May 26 12:46:21.290972 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Openstack-System-Scope: None May 26 12:46:21.290972 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: User-Agent: python-urllib3/1.26.9 May 26 12:46:21.290972 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Auth-Token: gAAAAABij3aJ6g5IoNxOEO-6RXpLhzi37ak_1VCrVEl83o5yr3jfLLbPj5OejaVZpkG9LLfzZPR1881yacCC1JRG9akKb3vHRR2cAmakhEbIU_fTBZlv2HME2_ABCS9Va1vmREct-lQoVuD1UWjNsW8-Alei9rc6fLsiFqU0fVmOGLmGYf4L9dE May 26 12:46:21.290972 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Domain-Id: None May 26 12:46:21.290972 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Domain-Name: None May 26 12:46:21.290972 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Identity-Status: Confirmed May 26 12:46:21.290972 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Is-Admin-Project: True May 26 12:46:21.290972 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Domain-Id: default May 26 12:46:21.290972 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Domain-Name: Default May 26 12:46:21.290972 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Id: fae36bb3997f4f14b8f1a0bcaf0fca1a May 26 12:46:21.290972 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2055236343 May 26 12:46:21.290972 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Role: member,reader May 26 12:46:21.290972 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Roles: member,reader May 26 12:46:21.293162 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/fae36bb3997f4f14b8f1a0bcaf0fca1a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/fae36bb3997f4f14b8f1a0bcaf0fca1a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/fae36bb3997f4f14b8f1a0bcaf0fca1a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_fae36bb3997f4f14b8f1a0bcaf0fca1a", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 26 12:46:21.293162 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2055236343 May 26 12:46:21.293162 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Tenant-Id: fae36bb3997f4f14b8f1a0bcaf0fca1a May 26 12:46:21.293162 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2055236343 May 26 12:46:21.293162 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User: tempest-VolumesSnapshotsTestJSON-2055236343-project May 26 12:46:21.293162 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Domain-Id: default May 26 12:46:21.293162 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Domain-Name: Default May 26 12:46:21.293162 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Id: d1a4623e202d4d359037fb958a4e1e7c May 26 12:46:21.293162 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2055236343-project May 26 12:46:21.293162 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: method: May 26 12:46:21.293162 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: exception: Volume fb31eb60-d419-4a58-b735-c01e5dceda03 could not be found. May 26 12:46:21.293162 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: action_args: {'id': 'fb31eb60-d419-4a58-b735-c01e5dceda03'} May 26 12:46:21.293162 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:46:21.294462 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:46:21.294462 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 12:46:21.294462 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 12:46:21.294462 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 26 12:46:21.294462 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 26 12:46:21.294462 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 26 12:46:21.294462 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 26 12:46:21.294462 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 26 12:46:21.294462 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 26 12:46:21.294462 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 26 12:46:21.294462 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 26 12:46:21.294462 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 12:46:21.294462 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 12:46:21.294462 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 12:46:21.294462 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 12:46:21.294462 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume fb31eb60-d419-4a58-b735-c01e5dceda03 could not be found. (HTTP 404) (Request-ID: req-8cdee1f6-6b57-4357-9e39-a78b125bb609) May 26 12:46:21.294462 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:46:21.294462 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:46:21.294462 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:46:21.296333 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:46:21.296333 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 26 12:46:21.296333 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 26 12:46:21.296333 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 12:46:21.296333 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 12:46:21.296333 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 12:46:21.296333 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 12:46:21.296333 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 12:46:21.296333 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 12:46:21.296333 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 12:46:21.296333 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 12:46:21.296333 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 26 12:46:21.296333 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 26 12:46:21.296333 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 26 12:46:21.296333 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 26 12:46:21.296333 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 26 12:46:21.296333 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 26 12:46:21.296333 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 26 12:46:21.296333 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 26 12:46:21.303743 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 12:46:21.303743 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 12:46:21.303743 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 12:46:21.303743 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 12:46:21.303743 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume fb31eb60-d419-4a58-b735-c01e5dceda03 could not be found. May 26 12:46:21.303743 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:46:21.303743 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:46:21.303743 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:46:21.303743 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:46:21.303743 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:46:21.303743 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:46:21.303743 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:46:21.303743 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:46:21.303743 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 12:46:21.303743 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 12:46:21.303743 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:46:21.303743 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:46:21.303743 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 26 12:46:21.303743 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:46:21.303743 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume fb31eb60-d419-4a58-b735-c01e5dceda03 could not be found. May 26 12:46:21.307708 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:46:21.307708 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:46:21.307708 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:46:21.307708 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:46:21.307708 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:46:21.307708 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:46:21.307708 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:46:21.307708 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:46:21.307708 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume fb31eb60-d419-4a58-b735-c01e5dceda03 could not be found. May 26 12:46:21.307708 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:46:21.307708 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-a472fd1a-e835-4bc7-9e23-0dbad370b597 tempest-VolumesSnapshotsTestJSON-2055236343 tempest-VolumesSnapshotsTestJSON-2055236343-project] Returning 404 to user: Volume fb31eb60-d419-4a58-b735-c01e5dceda03 could not be found. {{(pid=124824) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:46:21.307708 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-a472fd1a-e835-4bc7-9e23-0dbad370b597 tempest-VolumesSnapshotsTestJSON-2055236343 tempest-VolumesSnapshotsTestJSON-2055236343-project] 10.222.0.41 "DELETE /compute/v2.1/os-volumes/fb31eb60-d419-4a58-b735-c01e5dceda03" status: 404 len: 109 microversion: 2.1 time: 0.200966 May 26 12:46:21.307708 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 18/42] 10.222.0.41 () {58 vars in 1247 bytes} [Thu May 26 12:46:21 2022] DELETE /compute/v2.1/os-volumes/fb31eb60-d419-4a58-b735-c01e5dceda03 => generated 109 bytes in 206 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:46:21.310129 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-b8bf4de0-9a58-4b71-a116-50a496ebe431 tempest-VolumesTestJSON-913756250 tempest-VolumesTestJSON-913756250-project] Calling method '.version_select at 0x7f26a2b259d0>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:21.342067 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.quota [None req-d9659127-83fd-4162-9d92-565d9f6c54d3 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Getting quotas for project a90e7edce8984d49b7bdebed2947b436. Resources: {'key_pairs'} {{(pid=124823) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:46:21.362416 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.quota [None req-d9659127-83fd-4162-9d92-565d9f6c54d3 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Getting quotas for user 1e83db01f0b24204a61b037b3c1f044c and project a90e7edce8984d49b7bdebed2947b436. Resources: {'key_pairs'} {{(pid=124823) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:46:21.646325 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-b8bf4de0-9a58-4b71-a116-50a496ebe431 tempest-VolumesTestJSON-913756250 tempest-VolumesTestJSON-913756250-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.347503 May 26 12:46:21.647158 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 19/43] 10.222.0.41 () {58 vars in 1154 bytes} [Thu May 26 12:46:21 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:46:21.661977 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-7d27215f-6c41-408e-915c-a1da20d4e940 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:21.662640 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-7d27215f-6c41-408e-915c-a1da20d4e940 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] [instance: d3b264dc-45ea-4e2f-8e62-42f1b7424d50] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:21.673221 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-7d27215f-6c41-408e-915c-a1da20d4e940 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:21.675754 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-7d27215f-6c41-408e-915c-a1da20d4e940 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:21.676824 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-7d27215f-6c41-408e-915c-a1da20d4e940 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:21.679553 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-7d27215f-6c41-408e-915c-a1da20d4e940 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:21.807489 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-d9659127-83fd-4162-9d92-565d9f6c54d3 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 1.668573 May 26 12:46:21.813888 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 25/44] 10.222.0.41 () {62 vars in 1199 bytes} [Thu May 26 12:46:20 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 1670 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 26 12:46:21.818012 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-e6a7a457-3402-49ad-9b6f-967baad8a212 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:21.818645 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-e6a7a457-3402-49ad-9b6f-967baad8a212 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: a442ae3a-5311-4f8f-acf3-08ce1534c9ea] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:21.934873 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-e6a7a457-3402-49ad-9b6f-967baad8a212 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:21.960349 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-e6a7a457-3402-49ad-9b6f-967baad8a212 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea" status: 200 len: 1221 microversion: 2.1 time: 0.148653 May 26 12:46:21.967984 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 26/45] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:46:21 2022] GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea => generated 1221 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:46:21.968847 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-7d27215f-6c41-408e-915c-a1da20d4e940 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d380efbe8c44fb3bbc58c9913cb25e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd0ea68fb8a43e886d0c9722d766ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:21.981144 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-d23d652b-3f4a-43a7-b0e6-16e2e65c74cf tempest-VolumesSnapshotsTestJSON-2055236343 tempest-VolumesSnapshotsTestJSON-2055236343-project] Calling method '.version_select at 0x7f26a3372280>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:21.985018 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-7d27215f-6c41-408e-915c-a1da20d4e940 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] 10.222.0.41 "GET /compute/v2.1/servers/d3b264dc-45ea-4e2f-8e62-42f1b7424d50" status: 200 len: 1314 microversion: 2.1 time: 0.336865 May 26 12:46:21.985918 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 20/46] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:46:21 2022] GET /compute/v2.1/servers/d3b264dc-45ea-4e2f-8e62-42f1b7424d50 => generated 1314 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:46:21.999689 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-4d0fcb97-7369-4018-aab8-86b3d0cbcd9e tempest-VolumesTestJSON-913756250 tempest-VolumesTestJSON-913756250-project] Calling method '.version_select at 0x7f26a2aac310>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:22.043182 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.wsgi [None req-d23d652b-3f4a-43a7-b0e6-16e2e65c74cf tempest-VolumesSnapshotsTestJSON-2055236343 tempest-VolumesSnapshotsTestJSON-2055236343-project] HTTP exception thrown: Volume fb31eb60-d419-4a58-b735-c01e5dceda03 could not be found. May 26 12:46:22.045747 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-d23d652b-3f4a-43a7-b0e6-16e2e65c74cf tempest-VolumesSnapshotsTestJSON-2055236343 tempest-VolumesSnapshotsTestJSON-2055236343-project] Request method failure captured: May 26 12:46:22.045747 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: request: GET /compute/v2.1/os-volumes/fb31eb60-d419-4a58-b735-c01e5dceda03 HTTP/1.1 May 26 12:46:22.045747 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Accept: application/json May 26 12:46:22.045747 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Accept-Encoding: identity May 26 12:46:22.045747 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Connection: close May 26 12:46:22.045747 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Content-Length: 0 May 26 12:46:22.045747 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Content-Type: application/json May 26 12:46:22.045747 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Host: 10.222.0.41 May 26 12:46:22.045747 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Openstack-System-Scope: None May 26 12:46:22.045747 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: User-Agent: python-urllib3/1.26.9 May 26 12:46:22.045747 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Auth-Token: gAAAAABij3aJ6g5IoNxOEO-6RXpLhzi37ak_1VCrVEl83o5yr3jfLLbPj5OejaVZpkG9LLfzZPR1881yacCC1JRG9akKb3vHRR2cAmakhEbIU_fTBZlv2HME2_ABCS9Va1vmREct-lQoVuD1UWjNsW8-Alei9rc6fLsiFqU0fVmOGLmGYf4L9dE May 26 12:46:22.045747 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Domain-Id: None May 26 12:46:22.045747 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Domain-Name: None May 26 12:46:22.045747 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Identity-Status: Confirmed May 26 12:46:22.045747 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Is-Admin-Project: True May 26 12:46:22.045747 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Project-Domain-Id: default May 26 12:46:22.045747 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Project-Domain-Name: Default May 26 12:46:22.045747 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Project-Id: fae36bb3997f4f14b8f1a0bcaf0fca1a May 26 12:46:22.045747 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2055236343 May 26 12:46:22.045747 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Role: member,reader May 26 12:46:22.045747 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Roles: member,reader May 26 12:46:22.046833 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/fae36bb3997f4f14b8f1a0bcaf0fca1a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/fae36bb3997f4f14b8f1a0bcaf0fca1a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/fae36bb3997f4f14b8f1a0bcaf0fca1a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_fae36bb3997f4f14b8f1a0bcaf0fca1a", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 26 12:46:22.046833 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2055236343 May 26 12:46:22.046833 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Tenant-Id: fae36bb3997f4f14b8f1a0bcaf0fca1a May 26 12:46:22.046833 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2055236343 May 26 12:46:22.046833 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User: tempest-VolumesSnapshotsTestJSON-2055236343-project May 26 12:46:22.046833 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User-Domain-Id: default May 26 12:46:22.046833 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User-Domain-Name: Default May 26 12:46:22.046833 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User-Id: d1a4623e202d4d359037fb958a4e1e7c May 26 12:46:22.046833 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2055236343-project May 26 12:46:22.046833 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: method: May 26 12:46:22.046833 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: exception: Volume fb31eb60-d419-4a58-b735-c01e5dceda03 could not be found. May 26 12:46:22.046833 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: action_args: {'id': 'fb31eb60-d419-4a58-b735-c01e5dceda03'} May 26 12:46:22.046833 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:46:22.047431 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:46:22.047431 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 12:46:22.047431 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 12:46:22.047431 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 12:46:22.047431 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 12:46:22.047431 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 12:46:22.047431 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 12:46:22.047431 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 12:46:22.047431 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 12:46:22.047431 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 12:46:22.047431 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 12:46:22.047431 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 12:46:22.047431 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 12:46:22.047431 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 12:46:22.047431 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 12:46:22.047431 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume fb31eb60-d419-4a58-b735-c01e5dceda03 could not be found. (HTTP 404) (Request-ID: req-82105104-1242-4ac9-93bd-180b02356a97) May 26 12:46:22.047431 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:46:22.047431 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:46:22.047431 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:46:22.048295 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:46:22.048295 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 26 12:46:22.048295 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 26 12:46:22.048295 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 12:46:22.048295 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 12:46:22.048295 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 12:46:22.048295 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 12:46:22.048295 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 12:46:22.048295 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 12:46:22.048295 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 12:46:22.048295 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 12:46:22.048295 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 12:46:22.048295 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 12:46:22.048295 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 12:46:22.048295 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 12:46:22.048295 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 12:46:22.048295 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 12:46:22.048295 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 12:46:22.048295 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 12:46:22.049730 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 12:46:22.049730 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 12:46:22.049730 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 12:46:22.049730 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 12:46:22.049730 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume fb31eb60-d419-4a58-b735-c01e5dceda03 could not be found. May 26 12:46:22.049730 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:46:22.049730 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:46:22.049730 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:46:22.049730 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:46:22.049730 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:46:22.049730 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:46:22.049730 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:46:22.049730 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:46:22.049730 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 12:46:22.049730 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 12:46:22.049730 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:46:22.049730 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:46:22.049730 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 26 12:46:22.049730 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:46:22.049730 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume fb31eb60-d419-4a58-b735-c01e5dceda03 could not be found. May 26 12:46:22.050885 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:46:22.050885 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:46:22.050885 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:46:22.050885 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:46:22.050885 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:46:22.050885 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:46:22.050885 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:46:22.050885 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:46:22.050885 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume fb31eb60-d419-4a58-b735-c01e5dceda03 could not be found. May 26 12:46:22.050885 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:46:22.050885 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-d23d652b-3f4a-43a7-b0e6-16e2e65c74cf tempest-VolumesSnapshotsTestJSON-2055236343 tempest-VolumesSnapshotsTestJSON-2055236343-project] Returning 404 to user: Volume fb31eb60-d419-4a58-b735-c01e5dceda03 could not be found. {{(pid=124823) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:46:22.050885 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-d23d652b-3f4a-43a7-b0e6-16e2e65c74cf tempest-VolumesSnapshotsTestJSON-2055236343 tempest-VolumesSnapshotsTestJSON-2055236343-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/fb31eb60-d419-4a58-b735-c01e5dceda03" status: 404 len: 109 microversion: 2.1 time: 0.077950 May 26 12:46:22.050885 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 27/47] 10.222.0.41 () {58 vars in 1244 bytes} [Thu May 26 12:46:21 2022] GET /compute/v2.1/os-volumes/fb31eb60-d419-4a58-b735-c01e5dceda03 => generated 109 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:46:22.187797 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-4d0fcb97-7369-4018-aab8-86b3d0cbcd9e tempest-VolumesTestJSON-913756250 tempest-VolumesTestJSON-913756250-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.200650 May 26 12:46:22.188609 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 21/48] 10.222.0.41 () {58 vars in 1187 bytes} [Thu May 26 12:46:21 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:46:22.217725 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-c58e9723-94bf-42c9-8681-22575f59b41b tempest-VolumesTestJSON-913756250 tempest-VolumesTestJSON-913756250-project] Calling method '.version_select at 0x7f26a3372ca0>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:22.414893 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-c58e9723-94bf-42c9-8681-22575f59b41b tempest-VolumesTestJSON-913756250 tempest-VolumesTestJSON-913756250-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.216924 May 26 12:46:22.416530 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 28/49] 10.222.0.41 () {58 vars in 1154 bytes} [Thu May 26 12:46:22 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:46:22.979556 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-0d79159d-71e1-411d-adcd-7d804956e7e2 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:22.981328 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-0d79159d-71e1-411d-adcd-7d804956e7e2 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: a442ae3a-5311-4f8f-acf3-08ce1534c9ea] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:23.006217 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-8089fe03-45ad-44cd-9580-736b05dd6f27 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:23.006847 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-8089fe03-45ad-44cd-9580-736b05dd6f27 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] [instance: d3b264dc-45ea-4e2f-8e62-42f1b7424d50] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:23.489118 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-0d79159d-71e1-411d-adcd-7d804956e7e2 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:23.489118 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-0d79159d-71e1-411d-adcd-7d804956e7e2 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:23.498003 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-8089fe03-45ad-44cd-9580-736b05dd6f27 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:23.498003 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-8089fe03-45ad-44cd-9580-736b05dd6f27 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:23.498003 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-8089fe03-45ad-44cd-9580-736b05dd6f27 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:23.499333 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-0d79159d-71e1-411d-adcd-7d804956e7e2 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:23.499333 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-0d79159d-71e1-411d-adcd-7d804956e7e2 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:23.500356 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-8089fe03-45ad-44cd-9580-736b05dd6f27 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:23.500579 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-0d79159d-71e1-411d-adcd-7d804956e7e2 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:23.500579 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-0d79159d-71e1-411d-adcd-7d804956e7e2 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea" status: 200 len: 1225 microversion: 2.1 time: 0.509060 May 26 12:46:23.505096 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 22/50] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:46:22 2022] GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea => generated 1225 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:46:23.671499 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-8089fe03-45ad-44cd-9580-736b05dd6f27 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d380efbe8c44fb3bbc58c9913cb25e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd0ea68fb8a43e886d0c9722d766ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:23.687600 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-8089fe03-45ad-44cd-9580-736b05dd6f27 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] 10.222.0.41 "GET /compute/v2.1/servers/d3b264dc-45ea-4e2f-8e62-42f1b7424d50" status: 200 len: 1314 microversion: 2.1 time: 0.688499 May 26 12:46:23.688589 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 29/51] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:46:22 2022] GET /compute/v2.1/servers/d3b264dc-45ea-4e2f-8e62-42f1b7424d50 => generated 1314 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:46:24.524919 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-7e57956f-8ac4-4520-a3fa-7305fd10e1b9 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:24.526821 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-7e57956f-8ac4-4520-a3fa-7305fd10e1b9 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: a442ae3a-5311-4f8f-acf3-08ce1534c9ea] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:24.554797 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-7e57956f-8ac4-4520-a3fa-7305fd10e1b9 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:24.559855 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-7e57956f-8ac4-4520-a3fa-7305fd10e1b9 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:24.566856 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-7e57956f-8ac4-4520-a3fa-7305fd10e1b9 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:24.568251 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-7e57956f-8ac4-4520-a3fa-7305fd10e1b9 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:24.707188 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-647b329b-8931-4227-a77f-337a326309c8 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:24.708645 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-647b329b-8931-4227-a77f-337a326309c8 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] [instance: d3b264dc-45ea-4e2f-8e62-42f1b7424d50] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:24.744222 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-647b329b-8931-4227-a77f-337a326309c8 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:24.744222 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-647b329b-8931-4227-a77f-337a326309c8 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:24.760945 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-647b329b-8931-4227-a77f-337a326309c8 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:24.764156 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-647b329b-8931-4227-a77f-337a326309c8 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:24.909264 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-7e57956f-8ac4-4520-a3fa-7305fd10e1b9 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:24.929170 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-7e57956f-8ac4-4520-a3fa-7305fd10e1b9 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea" status: 200 len: 1225 microversion: 2.1 time: 0.405195 May 26 12:46:24.947972 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 23/52] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:46:24 2022] GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea => generated 1225 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:46:25.499321 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-6d68065b-7a68-404c-b099-9aaaaee8c2cd tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2116566281", "imageRef": "6df25342-b071-489b-a7c1-3089fa19af6d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fd8eb981-0241-4288-8206-05bf49eea8ea"}], "security_groups": [{"name": "tempest-securitygroup--820760474"}], "key_name": "tempest-keypair-113748839", "user_data": "}} {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:46:25.613507 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-647b329b-8931-4227-a77f-337a326309c8 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d380efbe8c44fb3bbc58c9913cb25e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd0ea68fb8a43e886d0c9722d766ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:25.638667 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-647b329b-8931-4227-a77f-337a326309c8 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] 10.222.0.41 "GET /compute/v2.1/servers/d3b264dc-45ea-4e2f-8e62-42f1b7424d50" status: 200 len: 1314 microversion: 2.1 time: 0.929187 May 26 12:46:25.642751 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 30/53] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:46:24 2022] GET /compute/v2.1/servers/d3b264dc-45ea-4e2f-8e62-42f1b7424d50 => generated 1314 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:46:25.957229 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-2c056135-20a4-4a02-b1bb-ba61c4297d42 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:25.959977 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-2c056135-20a4-4a02-b1bb-ba61c4297d42 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: a442ae3a-5311-4f8f-acf3-08ce1534c9ea] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:25.973179 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-2c056135-20a4-4a02-b1bb-ba61c4297d42 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:25.976382 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-2c056135-20a4-4a02-b1bb-ba61c4297d42 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:25.978033 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-2c056135-20a4-4a02-b1bb-ba61c4297d42 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:25.986785 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-2c056135-20a4-4a02-b1bb-ba61c4297d42 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:26.335530 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-2c056135-20a4-4a02-b1bb-ba61c4297d42 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:26.366260 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-2c056135-20a4-4a02-b1bb-ba61c4297d42 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea" status: 200 len: 1273 microversion: 2.1 time: 0.415174 May 26 12:46:26.386234 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 31/54] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:46:25 2022] GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea => generated 1273 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:46:26.408609 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.network.neutron [None req-6d68065b-7a68-404c-b099-9aaaaee8c2cd tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] validate_networks() for [('fd8eb981-0241-4288-8206-05bf49eea8ea', None, None, None, None, None)] {{(pid=124824) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 12:46:26.661620 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-80a1c7e4-e4de-453d-a131-c7dd363804c6 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:26.662717 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-80a1c7e4-e4de-453d-a131-c7dd363804c6 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] [instance: d3b264dc-45ea-4e2f-8e62-42f1b7424d50] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:26.677648 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-80a1c7e4-e4de-453d-a131-c7dd363804c6 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:26.678136 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-80a1c7e4-e4de-453d-a131-c7dd363804c6 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:26.678916 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-80a1c7e4-e4de-453d-a131-c7dd363804c6 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:26.679351 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-80a1c7e4-e4de-453d-a131-c7dd363804c6 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:27.453263 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-80a1c7e4-e4de-453d-a131-c7dd363804c6 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d380efbe8c44fb3bbc58c9913cb25e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd0ea68fb8a43e886d0c9722d766ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:27.478499 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-80a1c7e4-e4de-453d-a131-c7dd363804c6 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] 10.222.0.41 "GET /compute/v2.1/servers/d3b264dc-45ea-4e2f-8e62-42f1b7424d50" status: 200 len: 1314 microversion: 2.1 time: 0.806909 May 26 12:46:27.479734 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 32/55] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:46:26 2022] GET /compute/v2.1/servers/d3b264dc-45ea-4e2f-8e62-42f1b7424d50 => generated 1314 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:46:27.491752 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-145960b2-28b3-4203-bf9c-200fca31d142 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:27.493046 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-145960b2-28b3-4203-bf9c-200fca31d142 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: a442ae3a-5311-4f8f-acf3-08ce1534c9ea] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:27.530727 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-145960b2-28b3-4203-bf9c-200fca31d142 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:27.532686 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-145960b2-28b3-4203-bf9c-200fca31d142 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:27.533495 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-145960b2-28b3-4203-bf9c-200fca31d142 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:27.535918 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-145960b2-28b3-4203-bf9c-200fca31d142 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:27.824477 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-145960b2-28b3-4203-bf9c-200fca31d142 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:27.835503 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-145960b2-28b3-4203-bf9c-200fca31d142 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea" status: 200 len: 1281 microversion: 2.1 time: 0.354310 May 26 12:46:27.846070 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 33/56] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:46:27 2022] GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea => generated 1281 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:46:28.514952 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-8058217c-4f01-40e0-933f-e59729764a2b tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:28.514952 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-8058217c-4f01-40e0-933f-e59729764a2b tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] [instance: d3b264dc-45ea-4e2f-8e62-42f1b7424d50] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:28.533601 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-8058217c-4f01-40e0-933f-e59729764a2b tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:28.538629 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-8058217c-4f01-40e0-933f-e59729764a2b tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:28.540916 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-8058217c-4f01-40e0-933f-e59729764a2b tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:28.542956 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-8058217c-4f01-40e0-933f-e59729764a2b tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:29.056079 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-8058217c-4f01-40e0-933f-e59729764a2b tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d380efbe8c44fb3bbc58c9913cb25e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd0ea68fb8a43e886d0c9722d766ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:29.067287 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-8058217c-4f01-40e0-933f-e59729764a2b tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] 10.222.0.41 "GET /compute/v2.1/servers/d3b264dc-45ea-4e2f-8e62-42f1b7424d50" status: 200 len: 1314 microversion: 2.1 time: 0.567892 May 26 12:46:29.074143 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 34/57] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:46:28 2022] GET /compute/v2.1/servers/d3b264dc-45ea-4e2f-8e62-42f1b7424d50 => generated 1314 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:46:29.087103 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-2f2d6462-da3a-4f2c-ad20-702c30fec343 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:29.087837 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-2f2d6462-da3a-4f2c-ad20-702c30fec343 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: a442ae3a-5311-4f8f-acf3-08ce1534c9ea] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:29.107912 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-2f2d6462-da3a-4f2c-ad20-702c30fec343 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:29.108421 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-2f2d6462-da3a-4f2c-ad20-702c30fec343 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:29.109803 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-2f2d6462-da3a-4f2c-ad20-702c30fec343 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:29.113388 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-2f2d6462-da3a-4f2c-ad20-702c30fec343 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:29.399314 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-2f2d6462-da3a-4f2c-ad20-702c30fec343 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:29.413510 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-2f2d6462-da3a-4f2c-ad20-702c30fec343 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea" status: 200 len: 1279 microversion: 2.1 time: 0.338736 May 26 12:46:29.418590 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 35/58] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:46:29 2022] GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea => generated 1279 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:46:29.599726 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.virt.hardware [None req-6d68065b-7a68-404c-b099-9aaaaee8c2cd tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Flavor limits 0:0:0 {{(pid=124824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 12:46:29.600762 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.virt.hardware [None req-6d68065b-7a68-404c-b099-9aaaaee8c2cd tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Image limits 0:0:0 {{(pid=124824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 12:46:29.601620 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.virt.hardware [None req-6d68065b-7a68-404c-b099-9aaaaee8c2cd tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Flavor pref 0:0:0 {{(pid=124824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 12:46:29.601620 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.virt.hardware [None req-6d68065b-7a68-404c-b099-9aaaaee8c2cd tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Image pref 0:0:0 {{(pid=124824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 12:46:29.602413 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.virt.hardware [None req-6d68065b-7a68-404c-b099-9aaaaee8c2cd tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 12:46:29.628915 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-6d68065b-7a68-404c-b099-9aaaaee8c2cd tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:29.629429 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-6d68065b-7a68-404c-b099-9aaaaee8c2cd tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:29.630256 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-6d68065b-7a68-404c-b099-9aaaaee8c2cd tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:29.630689 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-6d68065b-7a68-404c-b099-9aaaaee8c2cd tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:29.707211 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.quota [None req-6d68065b-7a68-404c-b099-9aaaaee8c2cd tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Getting quotas for project cad768b45d17480d8d6bbbcff6032c8d. Resources: {'instances', 'ram', 'cores'} {{(pid=124824) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:46:29.712335 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.quota [None req-6d68065b-7a68-404c-b099-9aaaaee8c2cd tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Getting quotas for user 0537911b91184fcdbdcc9e93ec3fe5b9 and project cad768b45d17480d8d6bbbcff6032c8d. Resources: {'instances', 'ram', 'cores'} {{(pid=124824) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:46:29.770607 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-6d68065b-7a68-404c-b099-9aaaaee8c2cd tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Going to run 1 instances... {{(pid=124824) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 12:46:29.776952 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-6d68065b-7a68-404c-b099-9aaaaee8c2cd tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: 1a852e3a-0d2b-470a-a429-b4bac6aa8e6b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6df25342-b071-489b-a7c1-3089fa19af6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124824) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 12:46:30.090106 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-637d2ae8-07d2-4a01-a488-694fb8749361 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:30.090796 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-637d2ae8-07d2-4a01-a488-694fb8749361 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] [instance: d3b264dc-45ea-4e2f-8e62-42f1b7424d50] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:30.107471 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-637d2ae8-07d2-4a01-a488-694fb8749361 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:30.112183 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-637d2ae8-07d2-4a01-a488-694fb8749361 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:30.112183 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-637d2ae8-07d2-4a01-a488-694fb8749361 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:30.114694 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-637d2ae8-07d2-4a01-a488-694fb8749361 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:30.123586 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-6d68065b-7a68-404c-b099-9aaaaee8c2cd tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 4.630446 May 26 12:46:30.139490 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 24/59] 10.222.0.41 () {60 vars in 1146 bytes} [Thu May 26 12:46:25 2022] POST /compute/v2.1/servers => generated 401 bytes in 4647 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 26 12:46:30.153044 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-6343f845-adca-4d02-8d9d-40244602454e tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:30.164042 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-6343f845-adca-4d02-8d9d-40244602454e tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: 1a852e3a-0d2b-470a-a429-b4bac6aa8e6b] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:30.509274 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-637d2ae8-07d2-4a01-a488-694fb8749361 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d380efbe8c44fb3bbc58c9913cb25e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd0ea68fb8a43e886d0c9722d766ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:30.518864 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-637d2ae8-07d2-4a01-a488-694fb8749361 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] 10.222.0.41 "GET /compute/v2.1/servers/d3b264dc-45ea-4e2f-8e62-42f1b7424d50" status: 200 len: 1314 microversion: 2.1 time: 0.433206 May 26 12:46:30.520322 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 36/60] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:46:30 2022] GET /compute/v2.1/servers/d3b264dc-45ea-4e2f-8e62-42f1b7424d50 => generated 1314 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:46:30.527711 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-4923ef13-7bd7-4760-a0a0-5f7b783d77e4 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:30.528568 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-4923ef13-7bd7-4760-a0a0-5f7b783d77e4 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: a442ae3a-5311-4f8f-acf3-08ce1534c9ea] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:30.536093 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-4923ef13-7bd7-4760-a0a0-5f7b783d77e4 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:30.536934 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-4923ef13-7bd7-4760-a0a0-5f7b783d77e4 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:30.538130 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-4923ef13-7bd7-4760-a0a0-5f7b783d77e4 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:30.538898 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-4923ef13-7bd7-4760-a0a0-5f7b783d77e4 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:30.623049 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-6343f845-adca-4d02-8d9d-40244602454e tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0537911b91184fcdbdcc9e93ec3fe5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad768b45d17480d8d6bbbcff6032c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:30.636742 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-4923ef13-7bd7-4760-a0a0-5f7b783d77e4 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:30.638564 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-6343f845-adca-4d02-8d9d-40244602454e tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "GET /compute/v2.1/servers/1a852e3a-0d2b-470a-a429-b4bac6aa8e6b" status: 200 len: 1241 microversion: 2.1 time: 0.492729 May 26 12:46:30.639264 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 25/61] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:46:30 2022] GET /compute/v2.1/servers/1a852e3a-0d2b-470a-a429-b4bac6aa8e6b => generated 1241 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:46:30.648100 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-4923ef13-7bd7-4760-a0a0-5f7b783d77e4 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea" status: 200 len: 1279 microversion: 2.1 time: 0.126026 May 26 12:46:30.649323 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 37/62] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:46:30 2022] GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea => generated 1279 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:46:31.029212 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-81f33879-2f04-4144-97f8-4831ee3c8677 tempest-VolumesGetTestJSON-1179499469 tempest-VolumesGetTestJSON-1179499469-project] Action: 'create', calling method: .version_select at 0x7f26a2aace50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1208831674", "metadata": {"Type": "work"}}} {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:46:31.337377 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [req-99930ddb-9bfe-4a17-a387-a7ae6cf6b729 req-d64b0340-ceec-4e56-a04b-4039a38e73e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3b264dc-45ea-4e2f-8e62-42f1b7424d50", "tag": "44838f0a-08a0-4e0b-bb0c-fbfa649ef217"}]} {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:46:31.349691 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [req-99930ddb-9bfe-4a17-a387-a7ae6cf6b729 req-d64b0340-ceec-4e56-a04b-4039a38e73e7 service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:31.350438 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [req-99930ddb-9bfe-4a17-a387-a7ae6cf6b729 req-d64b0340-ceec-4e56-a04b-4039a38e73e7 service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:31.373846 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.compute.server_external_events [req-99930ddb-9bfe-4a17-a387-a7ae6cf6b729 req-d64b0340-ceec-4e56-a04b-4039a38e73e7 service nova] Creating event network-changed:44838f0a-08a0-4e0b-bb0c-fbfa649ef217 for instance d3b264dc-45ea-4e2f-8e62-42f1b7424d50 on hv-cinder-81571 May 26 12:46:31.374733 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [req-99930ddb-9bfe-4a17-a387-a7ae6cf6b729 req-d64b0340-ceec-4e56-a04b-4039a38e73e7 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124823) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 26 12:46:31.375855 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-bd8da173-7e72-44f1-b1ec-fb345c51a16c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:31.376299 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-bd8da173-7e72-44f1-b1ec-fb345c51a16c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:31.377080 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-bd8da173-7e72-44f1-b1ec-fb345c51a16c None None] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:31.377530 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-bd8da173-7e72-44f1-b1ec-fb345c51a16c None None] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:31.387922 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.compute.rpcapi [None req-bd8da173-7e72-44f1-b1ec-fb345c51a16c None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 26 12:46:31.388815 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-bd8da173-7e72-44f1-b1ec-fb345c51a16c None None] Releasing lock "compute-rpcapi-router" {{(pid=124823) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 26 12:46:31.409984 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-bd8da173-7e72-44f1-b1ec-fb345c51a16c None None] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.152521 May 26 12:46:31.410640 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 38/63] 10.222.0.41 () {64 vars in 1317 bytes} [Thu May 26 12:46:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:46:31.540287 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-a9162955-1dee-44a5-a1d0-cc1bbc82c726 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:31.579068 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-a9162955-1dee-44a5-a1d0-cc1bbc82c726 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] [instance: d3b264dc-45ea-4e2f-8e62-42f1b7424d50] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:31.599960 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-a9162955-1dee-44a5-a1d0-cc1bbc82c726 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:31.600422 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-a9162955-1dee-44a5-a1d0-cc1bbc82c726 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:31.604751 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-a9162955-1dee-44a5-a1d0-cc1bbc82c726 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:31.605861 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-a9162955-1dee-44a5-a1d0-cc1bbc82c726 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:31.949629 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG dbcounter [-] [124823] Writing DB stats nova_cell0:SELECT=10 {{(pid=124823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:46:31.993180 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-81f33879-2f04-4144-97f8-4831ee3c8677 tempest-VolumesGetTestJSON-1179499469 tempest-VolumesGetTestJSON-1179499469-project] 10.222.0.41 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.146849 May 26 12:46:31.997383 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 26/64] 10.222.0.41 () {60 vars in 1155 bytes} [Thu May 26 12:46:30 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 1152 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) May 26 12:46:32.015228 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-c55b06f9-de49-4797-ab79-62c6f76d093b tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:32.017658 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-c55b06f9-de49-4797-ab79-62c6f76d093b tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: 1a852e3a-0d2b-470a-a429-b4bac6aa8e6b] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:32.025503 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG dbcounter [-] [124824] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=12 {{(pid=124824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:46:32.033894 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-a9162955-1dee-44a5-a1d0-cc1bbc82c726 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d380efbe8c44fb3bbc58c9913cb25e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd0ea68fb8a43e886d0c9722d766ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:32.035713 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-c55b06f9-de49-4797-ab79-62c6f76d093b tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:32.042291 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-c55b06f9-de49-4797-ab79-62c6f76d093b tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:32.042291 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-c55b06f9-de49-4797-ab79-62c6f76d093b tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:32.042291 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-c55b06f9-de49-4797-ab79-62c6f76d093b tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:32.048954 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-a9162955-1dee-44a5-a1d0-cc1bbc82c726 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] 10.222.0.41 "GET /compute/v2.1/servers/d3b264dc-45ea-4e2f-8e62-42f1b7424d50" status: 200 len: 1314 microversion: 2.1 time: 0.515012 May 26 12:46:32.064089 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 39/65] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:46:31 2022] GET /compute/v2.1/servers/d3b264dc-45ea-4e2f-8e62-42f1b7424d50 => generated 1314 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:46:32.077404 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-4f92c11b-3449-48d4-9a5e-36f19aef747d tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:32.085405 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-4f92c11b-3449-48d4-9a5e-36f19aef747d tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: a442ae3a-5311-4f8f-acf3-08ce1534c9ea] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:32.096013 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-4f92c11b-3449-48d4-9a5e-36f19aef747d tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:32.097528 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-4f92c11b-3449-48d4-9a5e-36f19aef747d tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:32.099032 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-4f92c11b-3449-48d4-9a5e-36f19aef747d tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:32.099874 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-4f92c11b-3449-48d4-9a5e-36f19aef747d tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:32.358912 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-c55b06f9-de49-4797-ab79-62c6f76d093b tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0537911b91184fcdbdcc9e93ec3fe5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad768b45d17480d8d6bbbcff6032c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:32.374351 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-c55b06f9-de49-4797-ab79-62c6f76d093b tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "GET /compute/v2.1/servers/1a852e3a-0d2b-470a-a429-b4bac6aa8e6b" status: 200 len: 1245 microversion: 2.1 time: 0.375567 May 26 12:46:32.374937 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 27/66] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:46:31 2022] GET /compute/v2.1/servers/1a852e3a-0d2b-470a-a429-b4bac6aa8e6b => generated 1245 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:46:32.380377 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-0cb93aa7-6cd2-4341-a632-b76702a917d2 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-908779454", "imageRef": "6df25342-b071-489b-a7c1-3089fa19af6d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5ba883d8-de3a-4796-ad52-4228606fa333"}], "security_groups": [{"name": "tempest-securitygroup--805683062"}], "key_name": "tempest-keypair-186672759", "user_data": "}} {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:46:32.842519 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.network.neutron [None req-0cb93aa7-6cd2-4341-a632-b76702a917d2 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] validate_networks() for [('5ba883d8-de3a-4796-ad52-4228606fa333', None, None, None, None, None)] {{(pid=124824) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 12:46:32.849984 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-4f92c11b-3449-48d4-9a5e-36f19aef747d tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:32.910620 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-4f92c11b-3449-48d4-9a5e-36f19aef747d tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea" status: 200 len: 1321 microversion: 2.1 time: 0.843009 May 26 12:46:32.926032 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 40/67] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:46:32 2022] GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea => generated 1321 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:46:32.947473 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-6aab64a2-b137-42b2-b14b-ee19e3171113 tempest-VolumesGetTestJSON-1179499469 tempest-VolumesGetTestJSON-1179499469-project] Calling method '.version_select at 0x7f26a3372b80>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:33.207591 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-6aab64a2-b137-42b2-b14b-ee19e3171113 tempest-VolumesGetTestJSON-1179499469 tempest-VolumesGetTestJSON-1179499469-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/8ce1364a-4241-4445-a521-fbee287e8599" status: 200 len: 354 microversion: 2.1 time: 0.278908 May 26 12:46:33.208883 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 41/68] 10.222.0.41 () {58 vars in 1244 bytes} [Thu May 26 12:46:32 2022] GET /compute/v2.1/os-volumes/8ce1364a-4241-4445-a521-fbee287e8599 => generated 354 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:46:33.239439 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-8b43e42e-9c51-4362-94ac-aebd746e92a8 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:33.240336 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-8b43e42e-9c51-4362-94ac-aebd746e92a8 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] [instance: d3b264dc-45ea-4e2f-8e62-42f1b7424d50] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:33.258055 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-8b43e42e-9c51-4362-94ac-aebd746e92a8 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:33.259706 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-8b43e42e-9c51-4362-94ac-aebd746e92a8 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:33.261498 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-8b43e42e-9c51-4362-94ac-aebd746e92a8 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:33.264165 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-8b43e42e-9c51-4362-94ac-aebd746e92a8 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:33.727637 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-8b43e42e-9c51-4362-94ac-aebd746e92a8 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d380efbe8c44fb3bbc58c9913cb25e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd0ea68fb8a43e886d0c9722d766ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:33.748142 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG dbcounter [-] [124823] Writing DB stats nova_cell1:SELECT=100 {{(pid=124823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:46:33.759291 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-8b43e42e-9c51-4362-94ac-aebd746e92a8 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] 10.222.0.41 "GET /compute/v2.1/servers/d3b264dc-45ea-4e2f-8e62-42f1b7424d50" status: 200 len: 1314 microversion: 2.1 time: 0.547276 May 26 12:46:33.761253 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 42/69] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:46:33 2022] GET /compute/v2.1/servers/d3b264dc-45ea-4e2f-8e62-42f1b7424d50 => generated 1314 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:46:33.772284 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-cabf264d-5ec9-40f0-a08c-a2e0ffae8ccc tempest-VolumesGetTestJSON-1179499469 tempest-VolumesGetTestJSON-1179499469-project] Calling method '.version_select at 0x7f26a3372790>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:33.937743 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-cabf264d-5ec9-40f0-a08c-a2e0ffae8ccc tempest-VolumesGetTestJSON-1179499469 tempest-VolumesGetTestJSON-1179499469-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/8ce1364a-4241-4445-a521-fbee287e8599" status: 200 len: 354 microversion: 2.1 time: 0.173195 May 26 12:46:33.938591 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 43/70] 10.222.0.41 () {58 vars in 1244 bytes} [Thu May 26 12:46:33 2022] GET /compute/v2.1/os-volumes/8ce1364a-4241-4445-a521-fbee287e8599 => generated 354 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:46:33.955910 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-cd946485-919c-42b1-91fb-8f451d4555d6 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:33.957578 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-cd946485-919c-42b1-91fb-8f451d4555d6 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: 1a852e3a-0d2b-470a-a429-b4bac6aa8e6b] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:33.968309 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-cd946485-919c-42b1-91fb-8f451d4555d6 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:33.969157 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-cd946485-919c-42b1-91fb-8f451d4555d6 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:33.970301 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-cd946485-919c-42b1-91fb-8f451d4555d6 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:33.971701 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-cd946485-919c-42b1-91fb-8f451d4555d6 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:34.286862 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-cd946485-919c-42b1-91fb-8f451d4555d6 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0537911b91184fcdbdcc9e93ec3fe5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad768b45d17480d8d6bbbcff6032c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:34.293981 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-cd946485-919c-42b1-91fb-8f451d4555d6 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "GET /compute/v2.1/servers/1a852e3a-0d2b-470a-a429-b4bac6aa8e6b" status: 200 len: 1301 microversion: 2.1 time: 0.353556 May 26 12:46:34.309142 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 44/71] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:46:33 2022] GET /compute/v2.1/servers/1a852e3a-0d2b-470a-a429-b4bac6aa8e6b => generated 1301 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:46:34.339482 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-7fada72f-f9a2-4394-a396-30bd93bde2b8 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:34.340387 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-7fada72f-f9a2-4394-a396-30bd93bde2b8 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: a442ae3a-5311-4f8f-acf3-08ce1534c9ea] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:34.403010 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-7fada72f-f9a2-4394-a396-30bd93bde2b8 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:34.405183 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-7fada72f-f9a2-4394-a396-30bd93bde2b8 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:34.408763 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-7fada72f-f9a2-4394-a396-30bd93bde2b8 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:34.413274 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-7fada72f-f9a2-4394-a396-30bd93bde2b8 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:35.225342 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-7fada72f-f9a2-4394-a396-30bd93bde2b8 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:35.237745 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-7fada72f-f9a2-4394-a396-30bd93bde2b8 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea" status: 200 len: 1321 microversion: 2.1 time: 0.906998 May 26 12:46:35.269712 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 45/72] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:46:34 2022] GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea => generated 1321 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:46:35.280877 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-1b7c1179-d9c9-4494-8985-de7e2077bc45 tempest-VolumesGetTestJSON-1179499469 tempest-VolumesGetTestJSON-1179499469-project] Calling method '.version_select at 0x7f26a331aaf0>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:35.349870 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.virt.hardware [None req-0cb93aa7-6cd2-4341-a632-b76702a917d2 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Flavor limits 0:0:0 {{(pid=124824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 12:46:35.350411 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.virt.hardware [None req-0cb93aa7-6cd2-4341-a632-b76702a917d2 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Image limits 0:0:0 {{(pid=124824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 12:46:35.351170 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.virt.hardware [None req-0cb93aa7-6cd2-4341-a632-b76702a917d2 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Flavor pref 0:0:0 {{(pid=124824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 12:46:35.351676 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.virt.hardware [None req-0cb93aa7-6cd2-4341-a632-b76702a917d2 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Image pref 0:0:0 {{(pid=124824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 12:46:35.352092 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.virt.hardware [None req-0cb93aa7-6cd2-4341-a632-b76702a917d2 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 12:46:35.359094 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG dbcounter [-] [124824] Writing DB stats nova_cell0:SELECT=35 {{(pid=124824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:46:35.370253 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-0cb93aa7-6cd2-4341-a632-b76702a917d2 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:35.370979 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-0cb93aa7-6cd2-4341-a632-b76702a917d2 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:35.373354 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-0cb93aa7-6cd2-4341-a632-b76702a917d2 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:35.374490 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-0cb93aa7-6cd2-4341-a632-b76702a917d2 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:35.396156 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG dbcounter [-] [124824] Writing DB stats nova_cell0:SELECT=9 {{(pid=124824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:46:35.401506 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG dbcounter [-] [124824] Writing DB stats nova_cell1:SELECT=39 {{(pid=124824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:46:35.431382 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.quota [None req-0cb93aa7-6cd2-4341-a632-b76702a917d2 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Getting quotas for project a90e7edce8984d49b7bdebed2947b436. Resources: {'instances', 'ram', 'cores'} {{(pid=124824) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:46:35.439835 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.quota [None req-0cb93aa7-6cd2-4341-a632-b76702a917d2 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Getting quotas for user 1e83db01f0b24204a61b037b3c1f044c and project a90e7edce8984d49b7bdebed2947b436. Resources: {'instances', 'ram', 'cores'} {{(pid=124824) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:46:35.468172 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-0cb93aa7-6cd2-4341-a632-b76702a917d2 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Going to run 1 instances... {{(pid=124824) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 12:46:35.472046 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-0cb93aa7-6cd2-4341-a632-b76702a917d2 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 7ffbf048-2aa0-4656-a6cd-923b35031eaa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6df25342-b071-489b-a7c1-3089fa19af6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124824) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 12:46:35.718732 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-0cb93aa7-6cd2-4341-a632-b76702a917d2 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 3.340970 May 26 12:46:35.726297 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 28/73] 10.222.0.41 () {62 vars in 1187 bytes} [Thu May 26 12:46:32 2022] POST /compute/v2.1/servers => generated 401 bytes in 3350 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 26 12:46:35.854063 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-1b7c1179-d9c9-4494-8985-de7e2077bc45 tempest-VolumesGetTestJSON-1179499469 tempest-VolumesGetTestJSON-1179499469-project] 10.222.0.41 "DELETE /compute/v2.1/os-volumes/8ce1364a-4241-4445-a521-fbee287e8599" status: 202 len: 0 microversion: 2.1 time: 0.581336 May 26 12:46:35.855170 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 46/74] 10.222.0.41 () {58 vars in 1247 bytes} [Thu May 26 12:46:35 2022] DELETE /compute/v2.1/os-volumes/8ce1364a-4241-4445-a521-fbee287e8599 => generated 0 bytes in 584 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 12:46:35.890231 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-cc9ed7b9-e111-4f75-8896-856f90583dd0 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:35.895601 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-cc9ed7b9-e111-4f75-8896-856f90583dd0 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] [instance: d3b264dc-45ea-4e2f-8e62-42f1b7424d50] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:35.966070 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-cc9ed7b9-e111-4f75-8896-856f90583dd0 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:35.970046 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-cc9ed7b9-e111-4f75-8896-856f90583dd0 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:35.973196 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-cc9ed7b9-e111-4f75-8896-856f90583dd0 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:35.973962 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-cc9ed7b9-e111-4f75-8896-856f90583dd0 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:36.062156 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [req-c98a8f45-e52d-4384-a4ce-0d05138cf655 req-62963db0-b7e4-4f0f-bd93-092e87799381 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a", "tag": "dde1860d-27af-458a-a7db-62514bcc9e27"}]} {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:46:36.106493 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [req-c98a8f45-e52d-4384-a4ce-0d05138cf655 req-62963db0-b7e4-4f0f-bd93-092e87799381 service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:36.108447 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [req-c98a8f45-e52d-4384-a4ce-0d05138cf655 req-62963db0-b7e4-4f0f-bd93-092e87799381 service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:36.166416 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.compute.server_external_events [req-c98a8f45-e52d-4384-a4ce-0d05138cf655 req-62963db0-b7e4-4f0f-bd93-092e87799381 service nova] Creating event network-changed:dde1860d-27af-458a-a7db-62514bcc9e27 for instance c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a on hv-cinder-81571 May 26 12:46:36.166980 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [req-c98a8f45-e52d-4384-a4ce-0d05138cf655 req-62963db0-b7e4-4f0f-bd93-092e87799381 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124824) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 26 12:46:36.168133 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-825adc6d-e058-43d7-8548-2e79b4611957 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:36.168574 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-825adc6d-e058-43d7-8548-2e79b4611957 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:36.169370 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-825adc6d-e058-43d7-8548-2e79b4611957 None None] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:36.169832 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-825adc6d-e058-43d7-8548-2e79b4611957 None None] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:36.192740 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.compute.rpcapi [None req-825adc6d-e058-43d7-8548-2e79b4611957 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 26 12:46:36.193694 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-825adc6d-e058-43d7-8548-2e79b4611957 None None] Releasing lock "compute-rpcapi-router" {{(pid=124824) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 26 12:46:36.233368 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-825adc6d-e058-43d7-8548-2e79b4611957 None None] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.505428 May 26 12:46:36.234844 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 29/75] 10.222.0.41 () {64 vars in 1317 bytes} [Thu May 26 12:46:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:46:36.240600 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-78ceafcd-ec40-41b7-ac6f-59f65fae7723 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:36.241586 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-78ceafcd-ec40-41b7-ac6f-59f65fae7723 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: 1a852e3a-0d2b-470a-a429-b4bac6aa8e6b] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:36.274936 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-78ceafcd-ec40-41b7-ac6f-59f65fae7723 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:36.277514 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-78ceafcd-ec40-41b7-ac6f-59f65fae7723 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:36.278460 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-78ceafcd-ec40-41b7-ac6f-59f65fae7723 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:36.279474 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-78ceafcd-ec40-41b7-ac6f-59f65fae7723 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:36.358289 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-78ceafcd-ec40-41b7-ac6f-59f65fae7723 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0537911b91184fcdbdcc9e93ec3fe5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad768b45d17480d8d6bbbcff6032c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:36.366359 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-78ceafcd-ec40-41b7-ac6f-59f65fae7723 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "GET /compute/v2.1/servers/1a852e3a-0d2b-470a-a429-b4bac6aa8e6b" status: 200 len: 1299 microversion: 2.1 time: 0.130053 May 26 12:46:36.367153 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 30/76] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:46:36 2022] GET /compute/v2.1/servers/1a852e3a-0d2b-470a-a429-b4bac6aa8e6b => generated 1299 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:46:36.372364 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-cc9ed7b9-e111-4f75-8896-856f90583dd0 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d380efbe8c44fb3bbc58c9913cb25e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd0ea68fb8a43e886d0c9722d766ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:36.380254 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-104ac000-00c6-4ff4-b5f9-d93ba22a9e6f tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:36.380866 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-104ac000-00c6-4ff4-b5f9-d93ba22a9e6f tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 7ffbf048-2aa0-4656-a6cd-923b35031eaa] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:36.383288 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-cc9ed7b9-e111-4f75-8896-856f90583dd0 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] 10.222.0.41 "GET /compute/v2.1/servers/d3b264dc-45ea-4e2f-8e62-42f1b7424d50" status: 200 len: 1314 microversion: 2.1 time: 0.524563 May 26 12:46:36.383288 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 47/77] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:46:35 2022] GET /compute/v2.1/servers/d3b264dc-45ea-4e2f-8e62-42f1b7424d50 => generated 1314 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:46:36.388446 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-d8c1a774-5ba7-4715-8a2a-c119d177717b tempest-VolumesGetTestJSON-1179499469 tempest-VolumesGetTestJSON-1179499469-project] Calling method '.version_select at 0x7f26a331aee0>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:36.457029 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-104ac000-00c6-4ff4-b5f9-d93ba22a9e6f tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:36.457130 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-d8c1a774-5ba7-4715-8a2a-c119d177717b tempest-VolumesGetTestJSON-1179499469 tempest-VolumesGetTestJSON-1179499469-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/8ce1364a-4241-4445-a521-fbee287e8599" status: 200 len: 353 microversion: 2.1 time: 0.072013 May 26 12:46:36.457130 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 48/78] 10.222.0.41 () {58 vars in 1244 bytes} [Thu May 26 12:46:36 2022] GET /compute/v2.1/os-volumes/8ce1364a-4241-4445-a521-fbee287e8599 => generated 353 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:46:36.462570 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [req-a98b696c-0e8e-4282-aa06-46ea4c91961c req-172fcf38-56d7-43f7-addf-0277b3103a64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a442ae3a-5311-4f8f-acf3-08ce1534c9ea", "tag": "c5f9931f-3848-4a65-a86f-13a2bf480725"}]} {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:46:36.464374 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-104ac000-00c6-4ff4-b5f9-d93ba22a9e6f tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:36.465910 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-104ac000-00c6-4ff4-b5f9-d93ba22a9e6f tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:36.467018 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-104ac000-00c6-4ff4-b5f9-d93ba22a9e6f tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa" status: 200 len: 1280 microversion: 2.20 time: 0.098548 May 26 12:46:36.467576 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 31/79] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:46:36 2022] GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa => generated 1280 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:46:36.470966 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [req-a98b696c-0e8e-4282-aa06-46ea4c91961c req-172fcf38-56d7-43f7-addf-0277b3103a64 service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:36.471408 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [req-a98b696c-0e8e-4282-aa06-46ea4c91961c req-172fcf38-56d7-43f7-addf-0277b3103a64 service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:36.472130 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-be842240-e7bf-4fb2-a58f-8909b527dbfe tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:36.472732 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-be842240-e7bf-4fb2-a58f-8909b527dbfe tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: a442ae3a-5311-4f8f-acf3-08ce1534c9ea] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:36.479219 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-be842240-e7bf-4fb2-a58f-8909b527dbfe tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:36.479943 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-be842240-e7bf-4fb2-a58f-8909b527dbfe tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:36.480711 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-be842240-e7bf-4fb2-a58f-8909b527dbfe tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:36.481139 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-be842240-e7bf-4fb2-a58f-8909b527dbfe tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:36.484030 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.compute.server_external_events [req-a98b696c-0e8e-4282-aa06-46ea4c91961c req-172fcf38-56d7-43f7-addf-0277b3103a64 service nova] Creating event network-changed:c5f9931f-3848-4a65-a86f-13a2bf480725 for instance a442ae3a-5311-4f8f-acf3-08ce1534c9ea on hv-cinder-81571 May 26 12:46:36.489124 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [req-a98b696c-0e8e-4282-aa06-46ea4c91961c req-172fcf38-56d7-43f7-addf-0277b3103a64 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030601 May 26 12:46:36.489755 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 49/80] 10.222.0.41 () {64 vars in 1317 bytes} [Thu May 26 12:46:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:46:36.721608 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-be842240-e7bf-4fb2-a58f-8909b527dbfe tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:36.732423 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-be842240-e7bf-4fb2-a58f-8909b527dbfe tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea" status: 200 len: 1321 microversion: 2.1 time: 0.263783 May 26 12:46:36.733649 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 32/81] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:46:36 2022] GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea => generated 1321 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:46:37.392569 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-6e7ee3d1-5e19-46f0-a7ab-dca0572cd38d tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:37.394053 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-6e7ee3d1-5e19-46f0-a7ab-dca0572cd38d tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: 1a852e3a-0d2b-470a-a429-b4bac6aa8e6b] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:37.396603 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG dbcounter [-] [124823] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=2 {{(pid=124823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:46:37.403918 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-e4c3f0f1-2180-459b-b0ad-b9da43843f53 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:37.404606 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-e4c3f0f1-2180-459b-b0ad-b9da43843f53 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] [instance: d3b264dc-45ea-4e2f-8e62-42f1b7424d50] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:37.408338 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-6e7ee3d1-5e19-46f0-a7ab-dca0572cd38d tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:37.408835 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-6e7ee3d1-5e19-46f0-a7ab-dca0572cd38d tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:37.410573 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-6e7ee3d1-5e19-46f0-a7ab-dca0572cd38d tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:37.410573 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-6e7ee3d1-5e19-46f0-a7ab-dca0572cd38d tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:37.420716 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-e4c3f0f1-2180-459b-b0ad-b9da43843f53 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:37.421175 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-e4c3f0f1-2180-459b-b0ad-b9da43843f53 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:37.422081 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-e4c3f0f1-2180-459b-b0ad-b9da43843f53 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:37.422594 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-e4c3f0f1-2180-459b-b0ad-b9da43843f53 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:37.578534 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-e4c3f0f1-2180-459b-b0ad-b9da43843f53 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d380efbe8c44fb3bbc58c9913cb25e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd0ea68fb8a43e886d0c9722d766ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:37.589723 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-e4c3f0f1-2180-459b-b0ad-b9da43843f53 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] 10.222.0.41 "GET /compute/v2.1/servers/d3b264dc-45ea-4e2f-8e62-42f1b7424d50" status: 200 len: 1314 microversion: 2.1 time: 0.194149 May 26 12:46:37.590788 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 33/82] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:46:37 2022] GET /compute/v2.1/servers/d3b264dc-45ea-4e2f-8e62-42f1b7424d50 => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:46:37.595583 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-6e7ee3d1-5e19-46f0-a7ab-dca0572cd38d tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0537911b91184fcdbdcc9e93ec3fe5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad768b45d17480d8d6bbbcff6032c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:37.606058 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-6e7ee3d1-5e19-46f0-a7ab-dca0572cd38d tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "GET /compute/v2.1/servers/1a852e3a-0d2b-470a-a429-b4bac6aa8e6b" status: 200 len: 1366 microversion: 2.1 time: 0.218854 May 26 12:46:37.606685 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 50/83] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:46:37 2022] GET /compute/v2.1/servers/1a852e3a-0d2b-470a-a429-b4bac6aa8e6b => generated 1366 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:46:37.609435 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-7da9d136-6712-42ef-a3bb-8473ae0ee0ce tempest-VolumesGetTestJSON-1179499469 tempest-VolumesGetTestJSON-1179499469-project] Calling method '.version_select at 0x7f26a2a66310>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:37.618549 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-9dd20117-7f24-4c8b-a6f2-7fca5e93690e tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:37.618851 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-9dd20117-7f24-4c8b-a6f2-7fca5e93690e tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 7ffbf048-2aa0-4656-a6cd-923b35031eaa] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:37.625439 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-9dd20117-7f24-4c8b-a6f2-7fca5e93690e tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:37.625926 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-9dd20117-7f24-4c8b-a6f2-7fca5e93690e tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:37.626712 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-9dd20117-7f24-4c8b-a6f2-7fca5e93690e tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:37.627141 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-9dd20117-7f24-4c8b-a6f2-7fca5e93690e tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:37.663561 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-7da9d136-6712-42ef-a3bb-8473ae0ee0ce tempest-VolumesGetTestJSON-1179499469 tempest-VolumesGetTestJSON-1179499469-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/8ce1364a-4241-4445-a521-fbee287e8599" status: 200 len: 353 microversion: 2.1 time: 0.065545 May 26 12:46:37.665154 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 34/84] 10.222.0.41 () {58 vars in 1244 bytes} [Thu May 26 12:46:37 2022] GET /compute/v2.1/os-volumes/8ce1364a-4241-4445-a521-fbee287e8599 => generated 353 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:46:37.705288 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-9dd20117-7f24-4c8b-a6f2-7fca5e93690e tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:37.718113 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-9dd20117-7f24-4c8b-a6f2-7fca5e93690e tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:37.718113 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-9dd20117-7f24-4c8b-a6f2-7fca5e93690e tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:37.718864 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-9dd20117-7f24-4c8b-a6f2-7fca5e93690e tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa" status: 200 len: 1284 microversion: 2.20 time: 0.105260 May 26 12:46:37.719575 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 51/85] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:46:37 2022] GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa => generated 1284 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:46:37.755293 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-a03ca733-cd1a-4431-b36e-77ce57324e2e tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:37.756079 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-a03ca733-cd1a-4431-b36e-77ce57324e2e tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: a442ae3a-5311-4f8f-acf3-08ce1534c9ea] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:37.763609 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-a03ca733-cd1a-4431-b36e-77ce57324e2e tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:37.764089 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-a03ca733-cd1a-4431-b36e-77ce57324e2e tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:37.764866 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-a03ca733-cd1a-4431-b36e-77ce57324e2e tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:37.765654 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-a03ca733-cd1a-4431-b36e-77ce57324e2e tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:37.912547 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-a03ca733-cd1a-4431-b36e-77ce57324e2e tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:37.920332 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-a03ca733-cd1a-4431-b36e-77ce57324e2e tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea" status: 200 len: 1321 microversion: 2.1 time: 0.169645 May 26 12:46:37.920999 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 35/86] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:46:37 2022] GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea => generated 1321 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:46:38.611382 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-505d9f87-80d1-4464-a3ee-a6c5690bf657 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:38.612036 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-505d9f87-80d1-4464-a3ee-a6c5690bf657 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] [instance: d3b264dc-45ea-4e2f-8e62-42f1b7424d50] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:38.620304 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-505d9f87-80d1-4464-a3ee-a6c5690bf657 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:38.620745 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-505d9f87-80d1-4464-a3ee-a6c5690bf657 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:38.621501 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-505d9f87-80d1-4464-a3ee-a6c5690bf657 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:38.621959 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-505d9f87-80d1-4464-a3ee-a6c5690bf657 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:38.623995 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-2f8b5644-272b-452e-ad4c-a57b35a0a909 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:38.625010 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-2f8b5644-272b-452e-ad4c-a57b35a0a909 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: 1a852e3a-0d2b-470a-a429-b4bac6aa8e6b] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:38.632538 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-2f8b5644-272b-452e-ad4c-a57b35a0a909 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:38.633017 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-2f8b5644-272b-452e-ad4c-a57b35a0a909 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:38.634341 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-2f8b5644-272b-452e-ad4c-a57b35a0a909 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:38.634785 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-2f8b5644-272b-452e-ad4c-a57b35a0a909 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:38.794927 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-505d9f87-80d1-4464-a3ee-a6c5690bf657 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d380efbe8c44fb3bbc58c9913cb25e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd0ea68fb8a43e886d0c9722d766ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:38.799174 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-2f8b5644-272b-452e-ad4c-a57b35a0a909 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0537911b91184fcdbdcc9e93ec3fe5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad768b45d17480d8d6bbbcff6032c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:38.805219 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-505d9f87-80d1-4464-a3ee-a6c5690bf657 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] 10.222.0.41 "GET /compute/v2.1/servers/d3b264dc-45ea-4e2f-8e62-42f1b7424d50" status: 200 len: 1314 microversion: 2.1 time: 0.197233 May 26 12:46:38.806465 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 52/87] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:46:38 2022] GET /compute/v2.1/servers/d3b264dc-45ea-4e2f-8e62-42f1b7424d50 => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:46:38.812384 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-c092c586-aae3-4edf-b0b8-fc92521d1c88 tempest-VolumesGetTestJSON-1179499469 tempest-VolumesGetTestJSON-1179499469-project] Calling method '.version_select at 0x7f26a3c72550>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:38.830571 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-2f8b5644-272b-452e-ad4c-a57b35a0a909 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "GET /compute/v2.1/servers/1a852e3a-0d2b-470a-a429-b4bac6aa8e6b" status: 200 len: 1366 microversion: 2.1 time: 0.210834 May 26 12:46:38.831170 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 36/88] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:46:38 2022] GET /compute/v2.1/servers/1a852e3a-0d2b-470a-a429-b4bac6aa8e6b => generated 1366 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:46:38.845152 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-7866b8c1-88ef-4fb5-9e75-76f3db5dba4d tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:38.846774 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-7866b8c1-88ef-4fb5-9e75-76f3db5dba4d tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 7ffbf048-2aa0-4656-a6cd-923b35031eaa] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:38.862989 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-7866b8c1-88ef-4fb5-9e75-76f3db5dba4d tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:38.866438 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-7866b8c1-88ef-4fb5-9e75-76f3db5dba4d tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:38.877658 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-7866b8c1-88ef-4fb5-9e75-76f3db5dba4d tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:38.878336 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-7866b8c1-88ef-4fb5-9e75-76f3db5dba4d tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:38.897178 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-c092c586-aae3-4edf-b0b8-fc92521d1c88 tempest-VolumesGetTestJSON-1179499469 tempest-VolumesGetTestJSON-1179499469-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/8ce1364a-4241-4445-a521-fbee287e8599" status: 200 len: 353 microversion: 2.1 time: 0.088750 May 26 12:46:38.898524 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 53/89] 10.222.0.41 () {58 vars in 1244 bytes} [Thu May 26 12:46:38 2022] GET /compute/v2.1/os-volumes/8ce1364a-4241-4445-a521-fbee287e8599 => generated 353 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:46:38.938872 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-ae4178f0-f546-4b7f-9ada-5cb72d7f0f16 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:38.939849 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-ae4178f0-f546-4b7f-9ada-5cb72d7f0f16 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: a442ae3a-5311-4f8f-acf3-08ce1534c9ea] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:38.947293 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-ae4178f0-f546-4b7f-9ada-5cb72d7f0f16 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:38.948013 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-ae4178f0-f546-4b7f-9ada-5cb72d7f0f16 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:38.949479 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-ae4178f0-f546-4b7f-9ada-5cb72d7f0f16 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:38.950172 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-ae4178f0-f546-4b7f-9ada-5cb72d7f0f16 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:38.997566 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-7866b8c1-88ef-4fb5-9e75-76f3db5dba4d tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:39.007307 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-7866b8c1-88ef-4fb5-9e75-76f3db5dba4d tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:39.009781 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-7866b8c1-88ef-4fb5-9e75-76f3db5dba4d tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:39.014641 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-7866b8c1-88ef-4fb5-9e75-76f3db5dba4d tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa" status: 200 len: 1284 microversion: 2.20 time: 0.173159 May 26 12:46:39.014641 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 37/90] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:46:38 2022] GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa => generated 1284 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:46:39.156433 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-ae4178f0-f546-4b7f-9ada-5cb72d7f0f16 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:39.181084 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-ae4178f0-f546-4b7f-9ada-5cb72d7f0f16 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea" status: 200 len: 1321 microversion: 2.1 time: 0.244259 May 26 12:46:39.188200 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 54/91] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:46:38 2022] GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea => generated 1321 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:46:39.825458 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-3dfd88c0-c97e-41c7-8923-53bd5d18abc0 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:39.865243 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-3dfd88c0-c97e-41c7-8923-53bd5d18abc0 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] [instance: d3b264dc-45ea-4e2f-8e62-42f1b7424d50] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:39.865243 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-3dfd88c0-c97e-41c7-8923-53bd5d18abc0 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:39.865243 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-3dfd88c0-c97e-41c7-8923-53bd5d18abc0 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:39.865243 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-3dfd88c0-c97e-41c7-8923-53bd5d18abc0 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:39.866583 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-3dfd88c0-c97e-41c7-8923-53bd5d18abc0 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:39.866663 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-effc2a05-d540-4d53-92f4-6a2e9fd3255a tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:39.866663 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-effc2a05-d540-4d53-92f4-6a2e9fd3255a tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: 1a852e3a-0d2b-470a-a429-b4bac6aa8e6b] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:39.866663 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-effc2a05-d540-4d53-92f4-6a2e9fd3255a tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:39.866663 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-effc2a05-d540-4d53-92f4-6a2e9fd3255a tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:39.868300 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-effc2a05-d540-4d53-92f4-6a2e9fd3255a tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:39.868300 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-effc2a05-d540-4d53-92f4-6a2e9fd3255a tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:40.210969 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-3dfd88c0-c97e-41c7-8923-53bd5d18abc0 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d380efbe8c44fb3bbc58c9913cb25e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd0ea68fb8a43e886d0c9722d766ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:40.240176 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-3dfd88c0-c97e-41c7-8923-53bd5d18abc0 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] 10.222.0.41 "GET /compute/v2.1/servers/d3b264dc-45ea-4e2f-8e62-42f1b7424d50" status: 200 len: 1314 microversion: 2.1 time: 0.409767 May 26 12:46:40.241876 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 38/92] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:46:39 2022] GET /compute/v2.1/servers/d3b264dc-45ea-4e2f-8e62-42f1b7424d50 => generated 1314 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:46:40.261501 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-effc2a05-d540-4d53-92f4-6a2e9fd3255a tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0537911b91184fcdbdcc9e93ec3fe5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad768b45d17480d8d6bbbcff6032c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:40.271833 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-effc2a05-d540-4d53-92f4-6a2e9fd3255a tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "GET /compute/v2.1/servers/1a852e3a-0d2b-470a-a429-b4bac6aa8e6b" status: 200 len: 1366 microversion: 2.1 time: 0.427820 May 26 12:46:40.282760 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 55/93] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:46:39 2022] GET /compute/v2.1/servers/1a852e3a-0d2b-470a-a429-b4bac6aa8e6b => generated 1366 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:46:40.286738 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-403f0136-a56d-475f-9257-88cca951bc8a tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:40.287809 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-0cd835cd-8a27-404f-a526-77b84182ad58 tempest-VolumesGetTestJSON-1179499469 tempest-VolumesGetTestJSON-1179499469-project] Calling method '.version_select at 0x7f26a2aac940>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:40.288046 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-403f0136-a56d-475f-9257-88cca951bc8a tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 7ffbf048-2aa0-4656-a6cd-923b35031eaa] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:40.309779 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-403f0136-a56d-475f-9257-88cca951bc8a tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:40.310625 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-403f0136-a56d-475f-9257-88cca951bc8a tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:40.311773 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-403f0136-a56d-475f-9257-88cca951bc8a tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:40.312405 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-403f0136-a56d-475f-9257-88cca951bc8a tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:40.365755 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.wsgi [None req-0cd835cd-8a27-404f-a526-77b84182ad58 tempest-VolumesGetTestJSON-1179499469 tempest-VolumesGetTestJSON-1179499469-project] HTTP exception thrown: Volume 8ce1364a-4241-4445-a521-fbee287e8599 could not be found. May 26 12:46:40.369860 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-0cd835cd-8a27-404f-a526-77b84182ad58 tempest-VolumesGetTestJSON-1179499469 tempest-VolumesGetTestJSON-1179499469-project] Request method failure captured: May 26 12:46:40.369860 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: request: GET /compute/v2.1/os-volumes/8ce1364a-4241-4445-a521-fbee287e8599 HTTP/1.1 May 26 12:46:40.369860 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Accept: application/json May 26 12:46:40.369860 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Accept-Encoding: identity May 26 12:46:40.369860 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Connection: close May 26 12:46:40.369860 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Content-Length: 0 May 26 12:46:40.369860 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Content-Type: application/json May 26 12:46:40.369860 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Host: 10.222.0.41 May 26 12:46:40.369860 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Openstack-System-Scope: None May 26 12:46:40.369860 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: User-Agent: python-urllib3/1.26.9 May 26 12:46:40.369860 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Auth-Token: gAAAAABij3amTj4ZrnQ78dAEGl4rCLDSj8nGzN0igdXDslTnY5nse4N_wCKAPK5Ki5H_LqrTPwXPD1xRmC0m73oGDk-OvFExuAFIxaYb6Q0_y_DIiWTVu6WMZL0bBtQJrS9TRrcNKTXWR0tR3yZN3-kq8qW2U2ypODYipjIWlTrvizX7_iUr3kQ May 26 12:46:40.369860 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Domain-Id: None May 26 12:46:40.369860 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Domain-Name: None May 26 12:46:40.369860 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Identity-Status: Confirmed May 26 12:46:40.369860 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Is-Admin-Project: True May 26 12:46:40.369860 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Domain-Id: default May 26 12:46:40.369860 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Domain-Name: Default May 26 12:46:40.369860 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Id: 29c430d6cb8e4e02871d8beebadde414 May 26 12:46:40.369860 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Name: tempest-VolumesGetTestJSON-1179499469 May 26 12:46:40.369860 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Role: member,reader May 26 12:46:40.369860 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Roles: member,reader May 26 12:46:40.372233 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/29c430d6cb8e4e02871d8beebadde414"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/29c430d6cb8e4e02871d8beebadde414"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/29c430d6cb8e4e02871d8beebadde414"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_29c430d6cb8e4e02871d8beebadde414", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 26 12:46:40.372233 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Tenant: tempest-VolumesGetTestJSON-1179499469 May 26 12:46:40.372233 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Tenant-Id: 29c430d6cb8e4e02871d8beebadde414 May 26 12:46:40.372233 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Tenant-Name: tempest-VolumesGetTestJSON-1179499469 May 26 12:46:40.372233 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User: tempest-VolumesGetTestJSON-1179499469-project May 26 12:46:40.372233 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Domain-Id: default May 26 12:46:40.372233 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Domain-Name: Default May 26 12:46:40.372233 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Id: 7097a6336a6943dbb30fc4d531adb9fb May 26 12:46:40.372233 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Name: tempest-VolumesGetTestJSON-1179499469-project May 26 12:46:40.372233 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: method: May 26 12:46:40.372233 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: exception: Volume 8ce1364a-4241-4445-a521-fbee287e8599 could not be found. May 26 12:46:40.372233 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: action_args: {'id': '8ce1364a-4241-4445-a521-fbee287e8599'} May 26 12:46:40.372233 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:46:40.373139 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:46:40.373139 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 12:46:40.373139 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 12:46:40.373139 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 12:46:40.373139 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 12:46:40.373139 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 12:46:40.373139 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 12:46:40.373139 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 12:46:40.373139 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 12:46:40.373139 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 12:46:40.373139 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 12:46:40.373139 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 12:46:40.373139 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 12:46:40.373139 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 12:46:40.373139 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 12:46:40.373139 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8ce1364a-4241-4445-a521-fbee287e8599 could not be found. (HTTP 404) (Request-ID: req-31e0579a-4e3c-4986-bb79-e19f723cdadf) May 26 12:46:40.373139 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:46:40.373139 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:46:40.373139 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:46:40.374648 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:46:40.374648 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 26 12:46:40.374648 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 26 12:46:40.374648 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 12:46:40.374648 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 12:46:40.374648 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 12:46:40.374648 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 12:46:40.374648 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 12:46:40.374648 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 12:46:40.374648 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 12:46:40.374648 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 12:46:40.374648 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 12:46:40.374648 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 12:46:40.374648 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 12:46:40.374648 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 12:46:40.374648 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 12:46:40.374648 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 12:46:40.374648 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 12:46:40.374648 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 12:46:40.375591 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 12:46:40.375591 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 12:46:40.375591 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 12:46:40.375591 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 12:46:40.375591 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8ce1364a-4241-4445-a521-fbee287e8599 could not be found. May 26 12:46:40.375591 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:46:40.375591 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:46:40.375591 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:46:40.375591 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:46:40.375591 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:46:40.375591 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:46:40.375591 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:46:40.375591 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:46:40.375591 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 12:46:40.375591 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 12:46:40.375591 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:46:40.375591 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:46:40.375591 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 26 12:46:40.375591 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:46:40.375591 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8ce1364a-4241-4445-a521-fbee287e8599 could not be found. May 26 12:46:40.380704 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:46:40.380704 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:46:40.380704 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:46:40.380704 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:46:40.380704 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:46:40.380704 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:46:40.380704 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:46:40.380704 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:46:40.380704 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8ce1364a-4241-4445-a521-fbee287e8599 could not be found. May 26 12:46:40.380704 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:46:40.380704 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-0cd835cd-8a27-404f-a526-77b84182ad58 tempest-VolumesGetTestJSON-1179499469 tempest-VolumesGetTestJSON-1179499469-project] Returning 404 to user: Volume 8ce1364a-4241-4445-a521-fbee287e8599 could not be found. {{(pid=124824) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:46:40.380704 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-0cd835cd-8a27-404f-a526-77b84182ad58 tempest-VolumesGetTestJSON-1179499469 tempest-VolumesGetTestJSON-1179499469-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/8ce1364a-4241-4445-a521-fbee287e8599" status: 404 len: 109 microversion: 2.1 time: 0.124280 May 26 12:46:40.384395 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 39/94] 10.222.0.41 () {58 vars in 1244 bytes} [Thu May 26 12:46:40 2022] GET /compute/v2.1/os-volumes/8ce1364a-4241-4445-a521-fbee287e8599 => generated 109 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:46:40.393528 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-b5181250-4978-47e8-9ed5-5c839556906f tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:40.395270 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-b5181250-4978-47e8-9ed5-5c839556906f tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: a442ae3a-5311-4f8f-acf3-08ce1534c9ea] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:40.414042 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-b5181250-4978-47e8-9ed5-5c839556906f tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:40.414042 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-b5181250-4978-47e8-9ed5-5c839556906f tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:40.414042 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-b5181250-4978-47e8-9ed5-5c839556906f tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:40.414042 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-b5181250-4978-47e8-9ed5-5c839556906f tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:40.461921 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-403f0136-a56d-475f-9257-88cca951bc8a tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:40.475810 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-403f0136-a56d-475f-9257-88cca951bc8a tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:40.492720 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-403f0136-a56d-475f-9257-88cca951bc8a tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:40.498559 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-403f0136-a56d-475f-9257-88cca951bc8a tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa" status: 200 len: 1284 microversion: 2.20 time: 0.223061 May 26 12:46:40.501930 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 56/95] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:46:40 2022] GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa => generated 1284 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:46:40.906729 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-b5181250-4978-47e8-9ed5-5c839556906f tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:40.924381 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-b5181250-4978-47e8-9ed5-5c839556906f tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea" status: 200 len: 1321 microversion: 2.1 time: 0.536661 May 26 12:46:40.925894 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 40/96] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:46:40 2022] GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea => generated 1321 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:46:41.261754 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-023058dc-8b0d-487f-b3ba-a306a026428d tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:41.267999 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-023058dc-8b0d-487f-b3ba-a306a026428d tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] [instance: d3b264dc-45ea-4e2f-8e62-42f1b7424d50] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:41.272366 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-023058dc-8b0d-487f-b3ba-a306a026428d tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:41.272823 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-023058dc-8b0d-487f-b3ba-a306a026428d tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:41.274156 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-023058dc-8b0d-487f-b3ba-a306a026428d tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:41.274636 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-023058dc-8b0d-487f-b3ba-a306a026428d tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:41.302484 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-077f901a-79c1-4fea-b615-6510fa1f2bb8 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:41.303106 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-077f901a-79c1-4fea-b615-6510fa1f2bb8 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: 1a852e3a-0d2b-470a-a429-b4bac6aa8e6b] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:41.318196 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-077f901a-79c1-4fea-b615-6510fa1f2bb8 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:41.318748 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-077f901a-79c1-4fea-b615-6510fa1f2bb8 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:41.319796 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-077f901a-79c1-4fea-b615-6510fa1f2bb8 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:41.320339 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-077f901a-79c1-4fea-b615-6510fa1f2bb8 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:41.386847 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG dbcounter [-] [124823] Writing DB stats nova_cell0:SELECT=2 {{(pid=124823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:46:41.570794 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-077f901a-79c1-4fea-b615-6510fa1f2bb8 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0537911b91184fcdbdcc9e93ec3fe5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad768b45d17480d8d6bbbcff6032c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:41.573994 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-023058dc-8b0d-487f-b3ba-a306a026428d tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d380efbe8c44fb3bbc58c9913cb25e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd0ea68fb8a43e886d0c9722d766ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:41.581445 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-077f901a-79c1-4fea-b615-6510fa1f2bb8 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "GET /compute/v2.1/servers/1a852e3a-0d2b-470a-a429-b4bac6aa8e6b" status: 200 len: 1366 microversion: 2.1 time: 0.282736 May 26 12:46:41.582009 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-023058dc-8b0d-487f-b3ba-a306a026428d tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] 10.222.0.41 "GET /compute/v2.1/servers/d3b264dc-45ea-4e2f-8e62-42f1b7424d50" status: 200 len: 1314 microversion: 2.1 time: 0.327277 May 26 12:46:41.582651 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 57/97] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:46:41 2022] GET /compute/v2.1/servers/d3b264dc-45ea-4e2f-8e62-42f1b7424d50 => generated 1314 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:46:41.582873 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 41/98] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:46:41 2022] GET /compute/v2.1/servers/1a852e3a-0d2b-470a-a429-b4bac6aa8e6b => generated 1366 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:46:41.600666 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-b6a89800-07de-4795-93f1-d67af1404fdf tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:41.602327 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-b6a89800-07de-4795-93f1-d67af1404fdf tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 7ffbf048-2aa0-4656-a6cd-923b35031eaa] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:41.613846 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-b6a89800-07de-4795-93f1-d67af1404fdf tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:41.614703 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-b6a89800-07de-4795-93f1-d67af1404fdf tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:41.615914 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-b6a89800-07de-4795-93f1-d67af1404fdf tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:41.616489 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-b6a89800-07de-4795-93f1-d67af1404fdf tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:41.732617 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-b6a89800-07de-4795-93f1-d67af1404fdf tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:41.744644 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-b6a89800-07de-4795-93f1-d67af1404fdf tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:41.746289 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-b6a89800-07de-4795-93f1-d67af1404fdf tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:41.747573 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-b6a89800-07de-4795-93f1-d67af1404fdf tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa" status: 200 len: 1332 microversion: 2.20 time: 0.163444 May 26 12:46:41.748768 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 42/99] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:46:41 2022] GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa => generated 1332 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:46:41.944677 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-27eca76e-d4cd-4213-ab52-2adde44d525a tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:41.946641 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-27eca76e-d4cd-4213-ab52-2adde44d525a tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: a442ae3a-5311-4f8f-acf3-08ce1534c9ea] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:41.970217 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-27eca76e-d4cd-4213-ab52-2adde44d525a tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:41.970945 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-27eca76e-d4cd-4213-ab52-2adde44d525a tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:41.973165 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-27eca76e-d4cd-4213-ab52-2adde44d525a tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:41.974988 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-27eca76e-d4cd-4213-ab52-2adde44d525a tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:42.026177 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [req-c92713c4-dd67-4239-b214-419beee7e1a4 req-64d78e2f-b8a2-45c3-bfe2-998cce6a1e7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a852e3a-0d2b-470a-a429-b4bac6aa8e6b", "tag": "3cc1e56f-c372-4659-9acb-1c70403e8a78"}]} {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:46:42.040265 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [req-c92713c4-dd67-4239-b214-419beee7e1a4 req-64d78e2f-b8a2-45c3-bfe2-998cce6a1e7f service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:42.041313 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [req-c92713c4-dd67-4239-b214-419beee7e1a4 req-64d78e2f-b8a2-45c3-bfe2-998cce6a1e7f service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:42.058582 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.compute.server_external_events [req-c92713c4-dd67-4239-b214-419beee7e1a4 req-64d78e2f-b8a2-45c3-bfe2-998cce6a1e7f service nova] Creating event network-changed:3cc1e56f-c372-4659-9acb-1c70403e8a78 for instance 1a852e3a-0d2b-470a-a429-b4bac6aa8e6b on hv-cinder-81571 May 26 12:46:42.064336 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [req-c92713c4-dd67-4239-b214-419beee7e1a4 req-64d78e2f-b8a2-45c3-bfe2-998cce6a1e7f service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042621 May 26 12:46:42.071950 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 43/100] 10.222.0.41 () {64 vars in 1317 bytes} [Thu May 26 12:46:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:46:42.200371 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-27eca76e-d4cd-4213-ab52-2adde44d525a tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:42.208840 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-27eca76e-d4cd-4213-ab52-2adde44d525a tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea" status: 200 len: 1321 microversion: 2.1 time: 0.268247 May 26 12:46:42.209497 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 58/101] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:46:41 2022] GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea => generated 1321 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:46:42.613093 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-f1a8896d-6bec-4418-8b13-5e6bf441e4fd tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:42.615090 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-f1a8896d-6bec-4418-8b13-5e6bf441e4fd tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: 1a852e3a-0d2b-470a-a429-b4bac6aa8e6b] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:42.616612 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-336ed0fb-eff4-492a-bdea-95f2861e9054 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:42.618063 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-336ed0fb-eff4-492a-bdea-95f2861e9054 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] [instance: d3b264dc-45ea-4e2f-8e62-42f1b7424d50] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:42.625336 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-336ed0fb-eff4-492a-bdea-95f2861e9054 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:42.626077 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-336ed0fb-eff4-492a-bdea-95f2861e9054 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:42.627063 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-336ed0fb-eff4-492a-bdea-95f2861e9054 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:42.627642 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-336ed0fb-eff4-492a-bdea-95f2861e9054 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:42.641144 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-f1a8896d-6bec-4418-8b13-5e6bf441e4fd tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:42.642737 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-f1a8896d-6bec-4418-8b13-5e6bf441e4fd tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:42.645382 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-f1a8896d-6bec-4418-8b13-5e6bf441e4fd tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:42.647670 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-f1a8896d-6bec-4418-8b13-5e6bf441e4fd tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:42.836772 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-336ed0fb-eff4-492a-bdea-95f2861e9054 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d380efbe8c44fb3bbc58c9913cb25e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd0ea68fb8a43e886d0c9722d766ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:42.845307 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-336ed0fb-eff4-492a-bdea-95f2861e9054 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] 10.222.0.41 "GET /compute/v2.1/servers/d3b264dc-45ea-4e2f-8e62-42f1b7424d50" status: 200 len: 1314 microversion: 2.1 time: 0.243330 May 26 12:46:42.856020 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-f1a8896d-6bec-4418-8b13-5e6bf441e4fd tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0537911b91184fcdbdcc9e93ec3fe5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad768b45d17480d8d6bbbcff6032c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:42.857221 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 59/102] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:46:42 2022] GET /compute/v2.1/servers/d3b264dc-45ea-4e2f-8e62-42f1b7424d50 => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:46:42.863379 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-4b3eb835-b2a1-4273-826f-e97562dd3d5a tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:42.864394 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-4b3eb835-b2a1-4273-826f-e97562dd3d5a tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 7ffbf048-2aa0-4656-a6cd-923b35031eaa] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:42.864553 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-f1a8896d-6bec-4418-8b13-5e6bf441e4fd tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "GET /compute/v2.1/servers/1a852e3a-0d2b-470a-a429-b4bac6aa8e6b" status: 200 len: 1366 microversion: 2.1 time: 0.267771 May 26 12:46:42.865464 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 44/103] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:46:42 2022] GET /compute/v2.1/servers/1a852e3a-0d2b-470a-a429-b4bac6aa8e6b => generated 1366 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:46:42.871474 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-4b3eb835-b2a1-4273-826f-e97562dd3d5a tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:42.876918 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-4b3eb835-b2a1-4273-826f-e97562dd3d5a tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:42.876918 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-4b3eb835-b2a1-4273-826f-e97562dd3d5a tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:42.876918 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-4b3eb835-b2a1-4273-826f-e97562dd3d5a tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:42.938661 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-4b3eb835-b2a1-4273-826f-e97562dd3d5a tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:42.947638 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-4b3eb835-b2a1-4273-826f-e97562dd3d5a tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:42.949253 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-4b3eb835-b2a1-4273-826f-e97562dd3d5a tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:42.950407 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-4b3eb835-b2a1-4273-826f-e97562dd3d5a tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa" status: 200 len: 1340 microversion: 2.20 time: 0.091875 May 26 12:46:42.951211 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 60/104] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:46:42 2022] GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa => generated 1340 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:46:43.226869 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-f92f2388-0d36-4465-8e88-c8d37b3e438f tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:43.227641 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-f92f2388-0d36-4465-8e88-c8d37b3e438f tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: a442ae3a-5311-4f8f-acf3-08ce1534c9ea] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:43.233837 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-f92f2388-0d36-4465-8e88-c8d37b3e438f tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:43.234288 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-f92f2388-0d36-4465-8e88-c8d37b3e438f tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:43.235066 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-f92f2388-0d36-4465-8e88-c8d37b3e438f tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:43.235499 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-f92f2388-0d36-4465-8e88-c8d37b3e438f tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:43.377472 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-f92f2388-0d36-4465-8e88-c8d37b3e438f tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:43.385341 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-f92f2388-0d36-4465-8e88-c8d37b3e438f tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea" status: 200 len: 1321 microversion: 2.1 time: 0.163339 May 26 12:46:43.385950 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 45/105] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:46:43 2022] GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea => generated 1321 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:46:43.863595 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-f1c3ab3c-318c-44f3-9010-50d51793b502 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:43.864269 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-f1c3ab3c-318c-44f3-9010-50d51793b502 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] [instance: d3b264dc-45ea-4e2f-8e62-42f1b7424d50] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:43.871021 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-f1c3ab3c-318c-44f3-9010-50d51793b502 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:43.874641 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-f1c3ab3c-318c-44f3-9010-50d51793b502 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:43.874641 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-f1c3ab3c-318c-44f3-9010-50d51793b502 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:43.874641 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-f1c3ab3c-318c-44f3-9010-50d51793b502 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:43.883301 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-ade89d9b-8c87-4af5-95dc-c9a2014c9273 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:43.883978 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-ade89d9b-8c87-4af5-95dc-c9a2014c9273 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: 1a852e3a-0d2b-470a-a429-b4bac6aa8e6b] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:43.890957 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-ade89d9b-8c87-4af5-95dc-c9a2014c9273 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:43.891661 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-ade89d9b-8c87-4af5-95dc-c9a2014c9273 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:43.892743 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-ade89d9b-8c87-4af5-95dc-c9a2014c9273 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:43.893592 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-ade89d9b-8c87-4af5-95dc-c9a2014c9273 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:44.050895 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-ade89d9b-8c87-4af5-95dc-c9a2014c9273 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0537911b91184fcdbdcc9e93ec3fe5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad768b45d17480d8d6bbbcff6032c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:44.062163 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-ade89d9b-8c87-4af5-95dc-c9a2014c9273 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "GET /compute/v2.1/servers/1a852e3a-0d2b-470a-a429-b4bac6aa8e6b" status: 200 len: 1366 microversion: 2.1 time: 0.183119 May 26 12:46:44.063999 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 46/106] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:46:43 2022] GET /compute/v2.1/servers/1a852e3a-0d2b-470a-a429-b4bac6aa8e6b => generated 1366 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:46:44.079947 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-5d5c2b54-e213-448b-a0b9-dcf875fff509 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:44.079947 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-5d5c2b54-e213-448b-a0b9-dcf875fff509 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 7ffbf048-2aa0-4656-a6cd-923b35031eaa] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:44.083713 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-5d5c2b54-e213-448b-a0b9-dcf875fff509 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:44.084350 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-5d5c2b54-e213-448b-a0b9-dcf875fff509 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:44.085446 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-5d5c2b54-e213-448b-a0b9-dcf875fff509 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:44.086001 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-5d5c2b54-e213-448b-a0b9-dcf875fff509 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:44.182705 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-5d5c2b54-e213-448b-a0b9-dcf875fff509 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:44.191012 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-5d5c2b54-e213-448b-a0b9-dcf875fff509 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:44.192594 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-5d5c2b54-e213-448b-a0b9-dcf875fff509 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:44.193727 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-5d5c2b54-e213-448b-a0b9-dcf875fff509 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa" status: 200 len: 1340 microversion: 2.20 time: 0.128723 May 26 12:46:44.197911 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 47/107] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:46:44 2022] GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa => generated 1340 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:46:44.199561 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-f1c3ab3c-318c-44f3-9010-50d51793b502 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d380efbe8c44fb3bbc58c9913cb25e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd0ea68fb8a43e886d0c9722d766ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:44.207436 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-f1c3ab3c-318c-44f3-9010-50d51793b502 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] 10.222.0.41 "GET /compute/v2.1/servers/d3b264dc-45ea-4e2f-8e62-42f1b7424d50" status: 200 len: 1314 microversion: 2.1 time: 0.347651 May 26 12:46:44.208156 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 61/108] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:46:43 2022] GET /compute/v2.1/servers/d3b264dc-45ea-4e2f-8e62-42f1b7424d50 => generated 1314 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:46:44.404593 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-22b5dedd-210e-41d1-96fb-9eda9490780a tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:44.406110 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-22b5dedd-210e-41d1-96fb-9eda9490780a tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: a442ae3a-5311-4f8f-acf3-08ce1534c9ea] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:44.418815 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-22b5dedd-210e-41d1-96fb-9eda9490780a tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:44.421375 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-22b5dedd-210e-41d1-96fb-9eda9490780a tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:44.423729 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-22b5dedd-210e-41d1-96fb-9eda9490780a tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:44.424525 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-22b5dedd-210e-41d1-96fb-9eda9490780a tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:44.768780 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-22b5dedd-210e-41d1-96fb-9eda9490780a tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:44.789590 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-22b5dedd-210e-41d1-96fb-9eda9490780a tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea" status: 200 len: 1321 microversion: 2.1 time: 0.390943 May 26 12:46:44.791048 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 48/109] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:46:44 2022] GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea => generated 1321 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:46:45.093376 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-d53805c5-c53f-48f7-b96a-bed06ee32b6c tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:45.094796 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-d53805c5-c53f-48f7-b96a-bed06ee32b6c tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: 1a852e3a-0d2b-470a-a429-b4bac6aa8e6b] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:45.104840 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-d53805c5-c53f-48f7-b96a-bed06ee32b6c tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:45.106414 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-d53805c5-c53f-48f7-b96a-bed06ee32b6c tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:45.107846 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-d53805c5-c53f-48f7-b96a-bed06ee32b6c tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:45.108908 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-d53805c5-c53f-48f7-b96a-bed06ee32b6c tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:45.217632 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-1e8c0e4f-4b8d-44fe-b82e-71eda937c357 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:45.218679 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-1e8c0e4f-4b8d-44fe-b82e-71eda937c357 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 7ffbf048-2aa0-4656-a6cd-923b35031eaa] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:45.231537 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-1e8c0e4f-4b8d-44fe-b82e-71eda937c357 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:45.232017 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-1e8c0e4f-4b8d-44fe-b82e-71eda937c357 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:45.233600 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-1e8c0e4f-4b8d-44fe-b82e-71eda937c357 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:45.234588 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-1e8c0e4f-4b8d-44fe-b82e-71eda937c357 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:45.253942 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG dbcounter [-] [124824] Writing DB stats nova_cell1:SELECT=100 {{(pid=124824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:46:45.349264 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-1e8c0e4f-4b8d-44fe-b82e-71eda937c357 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:45.382851 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-1e8c0e4f-4b8d-44fe-b82e-71eda937c357 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:45.382851 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-1e8c0e4f-4b8d-44fe-b82e-71eda937c357 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:45.382851 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-1e8c0e4f-4b8d-44fe-b82e-71eda937c357 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa" status: 200 len: 1338 microversion: 2.20 time: 0.158748 May 26 12:46:45.383476 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 49/110] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:46:45 2022] GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa => generated 1338 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:46:45.383476 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-562d26e7-64ab-4110-96ea-6f72eb466269 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:45.383476 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-562d26e7-64ab-4110-96ea-6f72eb466269 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] [instance: d3b264dc-45ea-4e2f-8e62-42f1b7424d50] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:45.398682 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-562d26e7-64ab-4110-96ea-6f72eb466269 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:45.400230 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-562d26e7-64ab-4110-96ea-6f72eb466269 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:45.401657 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-d53805c5-c53f-48f7-b96a-bed06ee32b6c tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0537911b91184fcdbdcc9e93ec3fe5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad768b45d17480d8d6bbbcff6032c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:45.401886 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-562d26e7-64ab-4110-96ea-6f72eb466269 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:45.402580 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-562d26e7-64ab-4110-96ea-6f72eb466269 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:45.416670 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-d53805c5-c53f-48f7-b96a-bed06ee32b6c tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "GET /compute/v2.1/servers/1a852e3a-0d2b-470a-a429-b4bac6aa8e6b" status: 200 len: 1366 microversion: 2.1 time: 0.333462 May 26 12:46:45.418307 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 62/111] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:46:45 2022] GET /compute/v2.1/servers/1a852e3a-0d2b-470a-a429-b4bac6aa8e6b => generated 1366 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:46:45.641520 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-562d26e7-64ab-4110-96ea-6f72eb466269 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d380efbe8c44fb3bbc58c9913cb25e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd0ea68fb8a43e886d0c9722d766ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:45.657180 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-562d26e7-64ab-4110-96ea-6f72eb466269 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] 10.222.0.41 "GET /compute/v2.1/servers/d3b264dc-45ea-4e2f-8e62-42f1b7424d50" status: 200 len: 1314 microversion: 2.1 time: 0.283515 May 26 12:46:45.657964 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 50/112] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:46:45 2022] GET /compute/v2.1/servers/d3b264dc-45ea-4e2f-8e62-42f1b7424d50 => generated 1314 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:46:45.885890 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-a6a0ba4f-f1fa-4cfd-8896-2a6803c666af tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:45.885890 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-a6a0ba4f-f1fa-4cfd-8896-2a6803c666af tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: a442ae3a-5311-4f8f-acf3-08ce1534c9ea] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:45.885890 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-a6a0ba4f-f1fa-4cfd-8896-2a6803c666af tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:45.885890 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-a6a0ba4f-f1fa-4cfd-8896-2a6803c666af tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:45.886784 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-a6a0ba4f-f1fa-4cfd-8896-2a6803c666af tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:45.886784 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-a6a0ba4f-f1fa-4cfd-8896-2a6803c666af tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:45.977368 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-a6a0ba4f-f1fa-4cfd-8896-2a6803c666af tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:45.992534 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-a6a0ba4f-f1fa-4cfd-8896-2a6803c666af tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea" status: 200 len: 1321 microversion: 2.1 time: 0.190379 May 26 12:46:45.993408 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 63/113] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:46:45 2022] GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea => generated 1321 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:46:46.390130 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-31fec64f-fcdf-4c12-b483-310fd0de8524 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:46.390733 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-31fec64f-fcdf-4c12-b483-310fd0de8524 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 7ffbf048-2aa0-4656-a6cd-923b35031eaa] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:46.396995 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-31fec64f-fcdf-4c12-b483-310fd0de8524 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:46.397441 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-31fec64f-fcdf-4c12-b483-310fd0de8524 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:46.398228 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-31fec64f-fcdf-4c12-b483-310fd0de8524 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:46.399240 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-31fec64f-fcdf-4c12-b483-310fd0de8524 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:46.442012 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-11ceb480-750b-4939-9be3-46699c10b06d tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:46.442640 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-11ceb480-750b-4939-9be3-46699c10b06d tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: 1a852e3a-0d2b-470a-a429-b4bac6aa8e6b] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:46.450238 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-11ceb480-750b-4939-9be3-46699c10b06d tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:46.452974 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-11ceb480-750b-4939-9be3-46699c10b06d tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:46.452974 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-11ceb480-750b-4939-9be3-46699c10b06d tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:46.452974 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-11ceb480-750b-4939-9be3-46699c10b06d tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:46.457447 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG dbcounter [-] [124823] Writing DB stats nova_cell1:SELECT=100 {{(pid=124823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:46:46.464799 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-31fec64f-fcdf-4c12-b483-310fd0de8524 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:46.477373 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-31fec64f-fcdf-4c12-b483-310fd0de8524 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:46.479643 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-31fec64f-fcdf-4c12-b483-310fd0de8524 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:46.491865 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-31fec64f-fcdf-4c12-b483-310fd0de8524 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa" status: 200 len: 1338 microversion: 2.20 time: 0.094569 May 26 12:46:46.491865 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 51/114] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:46:46 2022] GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa => generated 1338 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:46:46.681324 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-0345795d-e0ba-4c15-a3c7-9dbc29f3743d tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:46.682748 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-0345795d-e0ba-4c15-a3c7-9dbc29f3743d tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] [instance: d3b264dc-45ea-4e2f-8e62-42f1b7424d50] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:46.685146 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG dbcounter [-] [124824] Writing DB stats nova_cell0:SELECT=7 {{(pid=124824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:46:46.687241 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG dbcounter [-] [124824] Writing DB stats nova_cell0:SELECT=3 {{(pid=124824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:46:46.693370 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-0345795d-e0ba-4c15-a3c7-9dbc29f3743d tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:46.694332 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-0345795d-e0ba-4c15-a3c7-9dbc29f3743d tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:46.695278 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-0345795d-e0ba-4c15-a3c7-9dbc29f3743d tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:46.696588 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-0345795d-e0ba-4c15-a3c7-9dbc29f3743d tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:46.704603 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-11ceb480-750b-4939-9be3-46699c10b06d tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0537911b91184fcdbdcc9e93ec3fe5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad768b45d17480d8d6bbbcff6032c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:46.715823 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-11ceb480-750b-4939-9be3-46699c10b06d tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "GET /compute/v2.1/servers/1a852e3a-0d2b-470a-a429-b4bac6aa8e6b" status: 200 len: 1366 microversion: 2.1 time: 0.277720 May 26 12:46:46.723164 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 64/115] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:46:46 2022] GET /compute/v2.1/servers/1a852e3a-0d2b-470a-a429-b4bac6aa8e6b => generated 1366 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:46:46.893446 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-0345795d-e0ba-4c15-a3c7-9dbc29f3743d tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d380efbe8c44fb3bbc58c9913cb25e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd0ea68fb8a43e886d0c9722d766ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:46.901575 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-0345795d-e0ba-4c15-a3c7-9dbc29f3743d tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] 10.222.0.41 "GET /compute/v2.1/servers/d3b264dc-45ea-4e2f-8e62-42f1b7424d50" status: 200 len: 1314 microversion: 2.1 time: 0.230402 May 26 12:46:46.912548 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 52/116] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:46:46 2022] GET /compute/v2.1/servers/d3b264dc-45ea-4e2f-8e62-42f1b7424d50 => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:46:47.009426 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-eb398911-3064-4680-bfb2-296e77918ece tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:47.010072 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-eb398911-3064-4680-bfb2-296e77918ece tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: a442ae3a-5311-4f8f-acf3-08ce1534c9ea] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:47.018109 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-eb398911-3064-4680-bfb2-296e77918ece tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:47.018109 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-eb398911-3064-4680-bfb2-296e77918ece tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:47.018409 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-eb398911-3064-4680-bfb2-296e77918ece tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:47.019036 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-eb398911-3064-4680-bfb2-296e77918ece tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:47.178600 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-eb398911-3064-4680-bfb2-296e77918ece tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:47.190342 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-eb398911-3064-4680-bfb2-296e77918ece tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea" status: 200 len: 1321 microversion: 2.1 time: 0.184905 May 26 12:46:47.191412 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 65/117] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:46:47 2022] GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea => generated 1321 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:46:47.505890 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-34167e5b-a411-4441-9a7b-f6afc5d98c8f tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:47.528612 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-34167e5b-a411-4441-9a7b-f6afc5d98c8f tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 7ffbf048-2aa0-4656-a6cd-923b35031eaa] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:47.528612 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-34167e5b-a411-4441-9a7b-f6afc5d98c8f tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:47.528612 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-34167e5b-a411-4441-9a7b-f6afc5d98c8f tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:47.528612 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-34167e5b-a411-4441-9a7b-f6afc5d98c8f tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:47.529128 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-34167e5b-a411-4441-9a7b-f6afc5d98c8f tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:47.735333 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-45079fc6-8aef-4de7-a4c9-45a211d3bed9 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:47.735958 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-45079fc6-8aef-4de7-a4c9-45a211d3bed9 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: 1a852e3a-0d2b-470a-a429-b4bac6aa8e6b] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:47.744776 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-45079fc6-8aef-4de7-a4c9-45a211d3bed9 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:47.745219 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-45079fc6-8aef-4de7-a4c9-45a211d3bed9 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:47.748857 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-45079fc6-8aef-4de7-a4c9-45a211d3bed9 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:47.749483 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-45079fc6-8aef-4de7-a4c9-45a211d3bed9 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:47.804452 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-34167e5b-a411-4441-9a7b-f6afc5d98c8f tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:47.819896 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-34167e5b-a411-4441-9a7b-f6afc5d98c8f tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:47.821593 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-34167e5b-a411-4441-9a7b-f6afc5d98c8f tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:47.822969 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-34167e5b-a411-4441-9a7b-f6afc5d98c8f tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa" status: 200 len: 1405 microversion: 2.20 time: 0.327240 May 26 12:46:47.838649 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 53/118] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:46:47 2022] GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa => generated 1405 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:46:47.920243 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-fc8b8be8-a694-4709-8cc4-8e0b0e87d7d5 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:47.920871 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-fc8b8be8-a694-4709-8cc4-8e0b0e87d7d5 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] [instance: d3b264dc-45ea-4e2f-8e62-42f1b7424d50] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:47.934585 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-fc8b8be8-a694-4709-8cc4-8e0b0e87d7d5 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:47.935033 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-fc8b8be8-a694-4709-8cc4-8e0b0e87d7d5 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:47.943364 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-fc8b8be8-a694-4709-8cc4-8e0b0e87d7d5 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:47.944122 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-fc8b8be8-a694-4709-8cc4-8e0b0e87d7d5 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:48.069420 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-45079fc6-8aef-4de7-a4c9-45a211d3bed9 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0537911b91184fcdbdcc9e93ec3fe5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad768b45d17480d8d6bbbcff6032c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:48.098912 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-45079fc6-8aef-4de7-a4c9-45a211d3bed9 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "GET /compute/v2.1/servers/1a852e3a-0d2b-470a-a429-b4bac6aa8e6b" status: 200 len: 1366 microversion: 2.1 time: 0.368706 May 26 12:46:48.100056 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 66/119] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:46:47 2022] GET /compute/v2.1/servers/1a852e3a-0d2b-470a-a429-b4bac6aa8e6b => generated 1366 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:46:48.224711 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-fc8b8be8-a694-4709-8cc4-8e0b0e87d7d5 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d380efbe8c44fb3bbc58c9913cb25e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd0ea68fb8a43e886d0c9722d766ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:48.230124 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-f65e03e1-41f2-408e-be18-dc8084d98353 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:48.230746 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-f65e03e1-41f2-408e-be18-dc8084d98353 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: a442ae3a-5311-4f8f-acf3-08ce1534c9ea] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:48.240955 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-fc8b8be8-a694-4709-8cc4-8e0b0e87d7d5 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] 10.222.0.41 "GET /compute/v2.1/servers/d3b264dc-45ea-4e2f-8e62-42f1b7424d50" status: 200 len: 1314 microversion: 2.1 time: 0.324861 May 26 12:46:48.241592 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 54/120] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:46:47 2022] GET /compute/v2.1/servers/d3b264dc-45ea-4e2f-8e62-42f1b7424d50 => generated 1314 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:46:48.247326 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-f65e03e1-41f2-408e-be18-dc8084d98353 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:48.247787 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-f65e03e1-41f2-408e-be18-dc8084d98353 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:48.251208 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-f65e03e1-41f2-408e-be18-dc8084d98353 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:48.251208 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-f65e03e1-41f2-408e-be18-dc8084d98353 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:48.449306 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-f65e03e1-41f2-408e-be18-dc8084d98353 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:48.460254 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-f65e03e1-41f2-408e-be18-dc8084d98353 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea" status: 200 len: 1321 microversion: 2.1 time: 0.247876 May 26 12:46:48.462319 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 67/121] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:46:48 2022] GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea => generated 1321 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:46:48.843162 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-25e5a122-ee38-481c-b315-b5d475946db4 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:48.843875 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-25e5a122-ee38-481c-b315-b5d475946db4 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 7ffbf048-2aa0-4656-a6cd-923b35031eaa] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:48.859483 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-25e5a122-ee38-481c-b315-b5d475946db4 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:48.860254 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-25e5a122-ee38-481c-b315-b5d475946db4 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:48.861182 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-25e5a122-ee38-481c-b315-b5d475946db4 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:48.861787 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-25e5a122-ee38-481c-b315-b5d475946db4 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:48.877040 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [req-67dd589a-e87e-4be9-a2fa-1bbd7dbb2041 req-b1c56ac7-6fb5-413d-bcdd-a029ee89176a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ffbf048-2aa0-4656-a6cd-923b35031eaa", "tag": "979ef417-a463-49c2-a7ae-7fae04d77dd9"}]} {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:46:48.889533 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [req-67dd589a-e87e-4be9-a2fa-1bbd7dbb2041 req-b1c56ac7-6fb5-413d-bcdd-a029ee89176a service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:48.890251 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [req-67dd589a-e87e-4be9-a2fa-1bbd7dbb2041 req-b1c56ac7-6fb5-413d-bcdd-a029ee89176a service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:48.911515 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.compute.server_external_events [req-67dd589a-e87e-4be9-a2fa-1bbd7dbb2041 req-b1c56ac7-6fb5-413d-bcdd-a029ee89176a service nova] Creating event network-changed:979ef417-a463-49c2-a7ae-7fae04d77dd9 for instance 7ffbf048-2aa0-4656-a6cd-923b35031eaa on hv-cinder-81571 May 26 12:46:48.926837 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [req-67dd589a-e87e-4be9-a2fa-1bbd7dbb2041 req-b1c56ac7-6fb5-413d-bcdd-a029ee89176a service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055850 May 26 12:46:48.927990 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 68/122] 10.222.0.41 () {64 vars in 1317 bytes} [Thu May 26 12:46:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:46:49.117577 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-4a8bca58-7b8b-4e16-9af5-1052667eab7d tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:49.118366 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-4a8bca58-7b8b-4e16-9af5-1052667eab7d tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: 1a852e3a-0d2b-470a-a429-b4bac6aa8e6b] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:49.125802 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-4a8bca58-7b8b-4e16-9af5-1052667eab7d tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:49.126566 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-4a8bca58-7b8b-4e16-9af5-1052667eab7d tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:49.127946 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-4a8bca58-7b8b-4e16-9af5-1052667eab7d tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:49.128438 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-4a8bca58-7b8b-4e16-9af5-1052667eab7d tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:49.172362 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-25e5a122-ee38-481c-b315-b5d475946db4 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:49.180454 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-25e5a122-ee38-481c-b315-b5d475946db4 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:49.182210 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-25e5a122-ee38-481c-b315-b5d475946db4 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:49.183458 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-25e5a122-ee38-481c-b315-b5d475946db4 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa" status: 200 len: 1405 microversion: 2.20 time: 0.344267 May 26 12:46:49.184075 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 55/123] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:46:48 2022] GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa => generated 1405 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:46:49.265581 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-ad448ebf-faf5-4406-8e90-a0953c9b19ab tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:49.266636 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-ad448ebf-faf5-4406-8e90-a0953c9b19ab tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] [instance: d3b264dc-45ea-4e2f-8e62-42f1b7424d50] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:49.275581 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-ad448ebf-faf5-4406-8e90-a0953c9b19ab tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:49.276268 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-ad448ebf-faf5-4406-8e90-a0953c9b19ab tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:49.277781 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-ad448ebf-faf5-4406-8e90-a0953c9b19ab tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:49.278225 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-ad448ebf-faf5-4406-8e90-a0953c9b19ab tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:49.360871 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-4a8bca58-7b8b-4e16-9af5-1052667eab7d tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0537911b91184fcdbdcc9e93ec3fe5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad768b45d17480d8d6bbbcff6032c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:49.376459 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-4a8bca58-7b8b-4e16-9af5-1052667eab7d tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "GET /compute/v2.1/servers/1a852e3a-0d2b-470a-a429-b4bac6aa8e6b" status: 200 len: 1366 microversion: 2.1 time: 0.259000 May 26 12:46:49.380552 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 69/124] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:46:49 2022] GET /compute/v2.1/servers/1a852e3a-0d2b-470a-a429-b4bac6aa8e6b => generated 1366 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:46:49.485356 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-9e758716-d3a0-4d61-9508-3530df1749ec tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:49.488783 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-9e758716-d3a0-4d61-9508-3530df1749ec tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: a442ae3a-5311-4f8f-acf3-08ce1534c9ea] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:49.502745 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-9e758716-d3a0-4d61-9508-3530df1749ec tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:49.503195 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-9e758716-d3a0-4d61-9508-3530df1749ec tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:49.509734 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-9e758716-d3a0-4d61-9508-3530df1749ec tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:49.509734 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-9e758716-d3a0-4d61-9508-3530df1749ec tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:49.599322 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-ad448ebf-faf5-4406-8e90-a0953c9b19ab tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d380efbe8c44fb3bbc58c9913cb25e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd0ea68fb8a43e886d0c9722d766ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:49.609058 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-ad448ebf-faf5-4406-8e90-a0953c9b19ab tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] 10.222.0.41 "GET /compute/v2.1/servers/d3b264dc-45ea-4e2f-8e62-42f1b7424d50" status: 200 len: 1314 microversion: 2.1 time: 0.347708 May 26 12:46:49.609892 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 56/125] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:46:49 2022] GET /compute/v2.1/servers/d3b264dc-45ea-4e2f-8e62-42f1b7424d50 => generated 1314 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:46:49.698180 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-9e758716-d3a0-4d61-9508-3530df1749ec tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:49.710093 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-9e758716-d3a0-4d61-9508-3530df1749ec tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea" status: 200 len: 1321 microversion: 2.1 time: 0.233601 May 26 12:46:49.710694 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 70/126] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:46:49 2022] GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea => generated 1321 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:46:50.204472 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-5df40b6f-3d5e-4727-ab0b-4c191022c245 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:50.205009 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-5df40b6f-3d5e-4727-ab0b-4c191022c245 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 7ffbf048-2aa0-4656-a6cd-923b35031eaa] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:50.213193 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-5df40b6f-3d5e-4727-ab0b-4c191022c245 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:50.214121 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-5df40b6f-3d5e-4727-ab0b-4c191022c245 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:50.215393 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-5df40b6f-3d5e-4727-ab0b-4c191022c245 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:50.215983 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-5df40b6f-3d5e-4727-ab0b-4c191022c245 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:50.386681 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-5df40b6f-3d5e-4727-ab0b-4c191022c245 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:50.396711 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-5df40b6f-3d5e-4727-ab0b-4c191022c245 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:50.398162 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-1f1b9dd3-40ed-4f51-b9d5-fade6c366e08 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:50.418905 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-5df40b6f-3d5e-4727-ab0b-4c191022c245 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:50.419927 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-1f1b9dd3-40ed-4f51-b9d5-fade6c366e08 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: 1a852e3a-0d2b-470a-a429-b4bac6aa8e6b] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:50.420370 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-5df40b6f-3d5e-4727-ab0b-4c191022c245 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa" status: 200 len: 1405 microversion: 2.20 time: 0.201052 May 26 12:46:50.420370 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 57/127] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:46:50 2022] GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa => generated 1405 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:46:50.420625 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-1f1b9dd3-40ed-4f51-b9d5-fade6c366e08 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:50.420625 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-1f1b9dd3-40ed-4f51-b9d5-fade6c366e08 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:50.420625 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-1f1b9dd3-40ed-4f51-b9d5-fade6c366e08 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:50.422520 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-1f1b9dd3-40ed-4f51-b9d5-fade6c366e08 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:50.591727 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-1f1b9dd3-40ed-4f51-b9d5-fade6c366e08 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0537911b91184fcdbdcc9e93ec3fe5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad768b45d17480d8d6bbbcff6032c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:50.601012 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-1f1b9dd3-40ed-4f51-b9d5-fade6c366e08 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "GET /compute/v2.1/servers/1a852e3a-0d2b-470a-a429-b4bac6aa8e6b" status: 200 len: 1366 microversion: 2.1 time: 0.207756 May 26 12:46:50.602780 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 71/128] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:46:50 2022] GET /compute/v2.1/servers/1a852e3a-0d2b-470a-a429-b4bac6aa8e6b => generated 1366 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:46:50.631154 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-87011913-b760-452f-976c-195aa88f56f7 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:50.638013 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-87011913-b760-452f-976c-195aa88f56f7 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] [instance: d3b264dc-45ea-4e2f-8e62-42f1b7424d50] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:50.664980 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-87011913-b760-452f-976c-195aa88f56f7 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:50.665696 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-87011913-b760-452f-976c-195aa88f56f7 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:50.666861 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-87011913-b760-452f-976c-195aa88f56f7 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:50.667702 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-87011913-b760-452f-976c-195aa88f56f7 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:50.726145 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-f43400ae-f59f-47d6-afee-4eddbe79203e tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:50.727769 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-f43400ae-f59f-47d6-afee-4eddbe79203e tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: a442ae3a-5311-4f8f-acf3-08ce1534c9ea] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:50.739760 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-f43400ae-f59f-47d6-afee-4eddbe79203e tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:50.743210 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-f43400ae-f59f-47d6-afee-4eddbe79203e tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:50.744283 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-f43400ae-f59f-47d6-afee-4eddbe79203e tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:50.744957 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-f43400ae-f59f-47d6-afee-4eddbe79203e tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:50.954593 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-87011913-b760-452f-976c-195aa88f56f7 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d380efbe8c44fb3bbc58c9913cb25e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd0ea68fb8a43e886d0c9722d766ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:50.966214 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-87011913-b760-452f-976c-195aa88f56f7 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] 10.222.0.41 "GET /compute/v2.1/servers/d3b264dc-45ea-4e2f-8e62-42f1b7424d50" status: 200 len: 1314 microversion: 2.1 time: 0.343414 May 26 12:46:50.967497 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 58/129] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:46:50 2022] GET /compute/v2.1/servers/d3b264dc-45ea-4e2f-8e62-42f1b7424d50 => generated 1314 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:46:51.094988 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-f43400ae-f59f-47d6-afee-4eddbe79203e tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:51.113087 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-f43400ae-f59f-47d6-afee-4eddbe79203e tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea" status: 200 len: 1321 microversion: 2.1 time: 0.390966 May 26 12:46:51.113893 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 72/130] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:46:50 2022] GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea => generated 1321 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:46:51.246341 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [req-79305d1e-170b-4704-ae7c-993b869faf8c req-d613110c-8d0d-4ba7-b975-6005d3aea142 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a", "name": "network-vif-plugged", "status": "completed", "tag": "dde1860d-27af-458a-a7db-62514bcc9e27"}]} {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:46:51.263488 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [req-79305d1e-170b-4704-ae7c-993b869faf8c req-d613110c-8d0d-4ba7-b975-6005d3aea142 service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:51.263488 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [req-79305d1e-170b-4704-ae7c-993b869faf8c req-d613110c-8d0d-4ba7-b975-6005d3aea142 service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:51.281276 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.compute.server_external_events [req-79305d1e-170b-4704-ae7c-993b869faf8c req-d613110c-8d0d-4ba7-b975-6005d3aea142 service nova] Creating event network-vif-plugged:dde1860d-27af-458a-a7db-62514bcc9e27 for instance c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a on hv-cinder-81571 May 26 12:46:51.293630 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [req-79305d1e-170b-4704-ae7c-993b869faf8c req-d613110c-8d0d-4ba7-b975-6005d3aea142 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126150 May 26 12:46:51.294267 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 59/131] 10.222.0.41 () {64 vars in 1317 bytes} [Thu May 26 12:46:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:46:51.425856 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-57cc8a15-adb9-49b8-b187-5e188e455de5 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:51.426599 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-57cc8a15-adb9-49b8-b187-5e188e455de5 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 7ffbf048-2aa0-4656-a6cd-923b35031eaa] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:51.433508 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-57cc8a15-adb9-49b8-b187-5e188e455de5 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:51.434003 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-57cc8a15-adb9-49b8-b187-5e188e455de5 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:51.434808 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-57cc8a15-adb9-49b8-b187-5e188e455de5 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:51.435236 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-57cc8a15-adb9-49b8-b187-5e188e455de5 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:51.624923 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-e4f690db-1981-45d1-a0f6-9d3ff16e431e tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:51.643994 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-e4f690db-1981-45d1-a0f6-9d3ff16e431e tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: 1a852e3a-0d2b-470a-a429-b4bac6aa8e6b] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:51.653947 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-57cc8a15-adb9-49b8-b187-5e188e455de5 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:51.658467 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-e4f690db-1981-45d1-a0f6-9d3ff16e431e tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:51.665927 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-57cc8a15-adb9-49b8-b187-5e188e455de5 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:51.668538 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-57cc8a15-adb9-49b8-b187-5e188e455de5 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:51.669213 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-e4f690db-1981-45d1-a0f6-9d3ff16e431e tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:51.669727 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-57cc8a15-adb9-49b8-b187-5e188e455de5 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa" status: 200 len: 1405 microversion: 2.20 time: 0.247730 May 26 12:46:51.670471 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 73/132] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:46:51 2022] GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa => generated 1405 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:46:51.682671 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-e4f690db-1981-45d1-a0f6-9d3ff16e431e tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:51.683248 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-e4f690db-1981-45d1-a0f6-9d3ff16e431e tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:51.937549 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-e4f690db-1981-45d1-a0f6-9d3ff16e431e tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0537911b91184fcdbdcc9e93ec3fe5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad768b45d17480d8d6bbbcff6032c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:51.946005 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-e4f690db-1981-45d1-a0f6-9d3ff16e431e tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "GET /compute/v2.1/servers/1a852e3a-0d2b-470a-a429-b4bac6aa8e6b" status: 200 len: 1366 microversion: 2.1 time: 0.330576 May 26 12:46:51.956652 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 60/133] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:46:51 2022] GET /compute/v2.1/servers/1a852e3a-0d2b-470a-a429-b4bac6aa8e6b => generated 1366 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:46:51.984702 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-e83179e0-aad9-4c77-b5ba-3b80aee1fbc3 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:51.985321 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-e83179e0-aad9-4c77-b5ba-3b80aee1fbc3 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] [instance: d3b264dc-45ea-4e2f-8e62-42f1b7424d50] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:52.001004 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-e83179e0-aad9-4c77-b5ba-3b80aee1fbc3 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:52.001004 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-e83179e0-aad9-4c77-b5ba-3b80aee1fbc3 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:52.001004 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-e83179e0-aad9-4c77-b5ba-3b80aee1fbc3 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:52.001004 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-e83179e0-aad9-4c77-b5ba-3b80aee1fbc3 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:52.132428 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-6c5594bd-2e46-4a61-804d-da09cbd07311 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:52.133632 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-6c5594bd-2e46-4a61-804d-da09cbd07311 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: a442ae3a-5311-4f8f-acf3-08ce1534c9ea] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:52.150275 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-6c5594bd-2e46-4a61-804d-da09cbd07311 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:52.151338 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-6c5594bd-2e46-4a61-804d-da09cbd07311 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:52.153632 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-6c5594bd-2e46-4a61-804d-da09cbd07311 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:52.154206 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-6c5594bd-2e46-4a61-804d-da09cbd07311 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:52.217260 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-e83179e0-aad9-4c77-b5ba-3b80aee1fbc3 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d380efbe8c44fb3bbc58c9913cb25e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd0ea68fb8a43e886d0c9722d766ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:52.226246 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-e83179e0-aad9-4c77-b5ba-3b80aee1fbc3 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] 10.222.0.41 "GET /compute/v2.1/servers/d3b264dc-45ea-4e2f-8e62-42f1b7424d50" status: 200 len: 1314 microversion: 2.1 time: 0.245448 May 26 12:46:52.227676 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 74/134] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:46:51 2022] GET /compute/v2.1/servers/d3b264dc-45ea-4e2f-8e62-42f1b7424d50 => generated 1314 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:46:52.346434 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-6c5594bd-2e46-4a61-804d-da09cbd07311 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:52.366375 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-6c5594bd-2e46-4a61-804d-da09cbd07311 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea" status: 200 len: 1321 microversion: 2.1 time: 0.239864 May 26 12:46:52.370671 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 61/135] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:46:52 2022] GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea => generated 1321 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:46:52.688549 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-71e91247-c737-4a47-9048-3440be0cc248 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:52.690022 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-71e91247-c737-4a47-9048-3440be0cc248 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 7ffbf048-2aa0-4656-a6cd-923b35031eaa] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:52.702444 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-71e91247-c737-4a47-9048-3440be0cc248 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:52.704252 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-71e91247-c737-4a47-9048-3440be0cc248 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:52.707764 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-71e91247-c737-4a47-9048-3440be0cc248 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:52.708467 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-71e91247-c737-4a47-9048-3440be0cc248 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:52.915657 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-71e91247-c737-4a47-9048-3440be0cc248 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:52.928983 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-71e91247-c737-4a47-9048-3440be0cc248 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:52.930838 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-71e91247-c737-4a47-9048-3440be0cc248 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:52.932081 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-71e91247-c737-4a47-9048-3440be0cc248 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa" status: 200 len: 1405 microversion: 2.20 time: 0.247900 May 26 12:46:52.946574 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 75/136] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:46:52 2022] GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa => generated 1405 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:46:52.973615 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-043c7bb9-9294-482c-b7df-0e1e6bcac05f tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:52.974386 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-043c7bb9-9294-482c-b7df-0e1e6bcac05f tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: 1a852e3a-0d2b-470a-a429-b4bac6aa8e6b] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:52.981327 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-043c7bb9-9294-482c-b7df-0e1e6bcac05f tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:52.987257 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-043c7bb9-9294-482c-b7df-0e1e6bcac05f tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:52.987257 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-043c7bb9-9294-482c-b7df-0e1e6bcac05f tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:52.987257 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-043c7bb9-9294-482c-b7df-0e1e6bcac05f tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:53.404045 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-043c7bb9-9294-482c-b7df-0e1e6bcac05f tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0537911b91184fcdbdcc9e93ec3fe5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad768b45d17480d8d6bbbcff6032c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:53.404045 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-043c7bb9-9294-482c-b7df-0e1e6bcac05f tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "GET /compute/v2.1/servers/1a852e3a-0d2b-470a-a429-b4bac6aa8e6b" status: 200 len: 1366 microversion: 2.1 time: 0.195767 May 26 12:46:53.404045 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 62/137] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:46:52 2022] GET /compute/v2.1/servers/1a852e3a-0d2b-470a-a429-b4bac6aa8e6b => generated 1366 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:46:53.406022 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-15385b0a-f018-4340-bc26-972a00afa9ca tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:53.406022 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-15385b0a-f018-4340-bc26-972a00afa9ca tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] [instance: d3b264dc-45ea-4e2f-8e62-42f1b7424d50] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:53.406022 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-15385b0a-f018-4340-bc26-972a00afa9ca tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:53.406022 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-15385b0a-f018-4340-bc26-972a00afa9ca tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:53.406962 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-15385b0a-f018-4340-bc26-972a00afa9ca tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:53.406962 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-15385b0a-f018-4340-bc26-972a00afa9ca tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:53.407563 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [req-b2c0044a-b958-4c8b-8a97-87171c341984 req-395fe937-203b-47fd-a3c5-216bbac79396 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3b264dc-45ea-4e2f-8e62-42f1b7424d50", "name": "network-vif-plugged", "status": "completed", "tag": "44838f0a-08a0-4e0b-bb0c-fbfa649ef217"}, {"server_uuid": "a442ae3a-5311-4f8f-acf3-08ce1534c9ea", "name": "network-vif-plugged", "status": "completed", "tag": "c5f9931f-3848-4a65-a86f-13a2bf480725"}, {"server_uuid": "1a852e3a-0d2b-470a-a429-b4bac6aa8e6b", "name": "network-vif-plugged", "status": "completed", "tag": "3cc1e56f-c372-4659-9acb-1c70403e8a78"}]} {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:46:53.407563 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [req-b2c0044a-b958-4c8b-8a97-87171c341984 req-395fe937-203b-47fd-a3c5-216bbac79396 service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:53.407563 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [req-b2c0044a-b958-4c8b-8a97-87171c341984 req-395fe937-203b-47fd-a3c5-216bbac79396 service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:53.408277 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.compute.server_external_events [req-b2c0044a-b958-4c8b-8a97-87171c341984 req-395fe937-203b-47fd-a3c5-216bbac79396 service nova] Creating event network-vif-plugged:44838f0a-08a0-4e0b-bb0c-fbfa649ef217 for instance d3b264dc-45ea-4e2f-8e62-42f1b7424d50 on hv-cinder-81571 May 26 12:46:53.408277 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.compute.server_external_events [req-b2c0044a-b958-4c8b-8a97-87171c341984 req-395fe937-203b-47fd-a3c5-216bbac79396 service nova] Creating event network-vif-plugged:c5f9931f-3848-4a65-a86f-13a2bf480725 for instance a442ae3a-5311-4f8f-acf3-08ce1534c9ea on hv-cinder-81571 May 26 12:46:53.408277 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.compute.server_external_events [req-b2c0044a-b958-4c8b-8a97-87171c341984 req-395fe937-203b-47fd-a3c5-216bbac79396 service nova] Creating event network-vif-plugged:3cc1e56f-c372-4659-9acb-1c70403e8a78 for instance 1a852e3a-0d2b-470a-a429-b4bac6aa8e6b on hv-cinder-81571 May 26 12:46:53.408277 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [req-b2c0044a-b958-4c8b-8a97-87171c341984 req-395fe937-203b-47fd-a3c5-216bbac79396 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.041847 May 26 12:46:53.408277 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 63/138] 10.222.0.41 () {64 vars in 1317 bytes} [Thu May 26 12:46:53 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:46:53.408277 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-ab818940-a678-434a-86aa-08456010f6c5 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:53.408803 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-ab818940-a678-434a-86aa-08456010f6c5 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: a442ae3a-5311-4f8f-acf3-08ce1534c9ea] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:53.409284 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-15385b0a-f018-4340-bc26-972a00afa9ca tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d380efbe8c44fb3bbc58c9913cb25e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd0ea68fb8a43e886d0c9722d766ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:53.409458 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-ab818940-a678-434a-86aa-08456010f6c5 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:53.409458 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-ab818940-a678-434a-86aa-08456010f6c5 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:53.409458 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-ab818940-a678-434a-86aa-08456010f6c5 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:53.409458 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-ab818940-a678-434a-86aa-08456010f6c5 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:53.413535 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-15385b0a-f018-4340-bc26-972a00afa9ca tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] 10.222.0.41 "GET /compute/v2.1/servers/d3b264dc-45ea-4e2f-8e62-42f1b7424d50" status: 200 len: 1314 microversion: 2.1 time: 0.170198 May 26 12:46:53.414501 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 76/139] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:46:53 2022] GET /compute/v2.1/servers/d3b264dc-45ea-4e2f-8e62-42f1b7424d50 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:46:53.602331 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-ab818940-a678-434a-86aa-08456010f6c5 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:53.612016 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-ab818940-a678-434a-86aa-08456010f6c5 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea" status: 200 len: 1321 microversion: 2.1 time: 0.226446 May 26 12:46:53.612954 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 64/140] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:46:53 2022] GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea => generated 1321 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:46:53.952720 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-6d982b5e-30d8-4b24-94ad-bd4256d0645b tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:53.953962 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-6d982b5e-30d8-4b24-94ad-bd4256d0645b tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 7ffbf048-2aa0-4656-a6cd-923b35031eaa] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:53.967995 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-6d982b5e-30d8-4b24-94ad-bd4256d0645b tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:53.970725 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-6d982b5e-30d8-4b24-94ad-bd4256d0645b tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:53.971773 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-6d982b5e-30d8-4b24-94ad-bd4256d0645b tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:53.974923 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-6d982b5e-30d8-4b24-94ad-bd4256d0645b tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:54.174172 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-05298c07-ae29-4bc1-a881-5638fbe5e4d6 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:54.178321 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-05298c07-ae29-4bc1-a881-5638fbe5e4d6 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: 1a852e3a-0d2b-470a-a429-b4bac6aa8e6b] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:54.185229 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-05298c07-ae29-4bc1-a881-5638fbe5e4d6 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:54.186378 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-05298c07-ae29-4bc1-a881-5638fbe5e4d6 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:54.187536 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-05298c07-ae29-4bc1-a881-5638fbe5e4d6 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:54.188047 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-05298c07-ae29-4bc1-a881-5638fbe5e4d6 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:54.212558 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-6d982b5e-30d8-4b24-94ad-bd4256d0645b tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:54.224362 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-6d982b5e-30d8-4b24-94ad-bd4256d0645b tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:54.228985 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-6d982b5e-30d8-4b24-94ad-bd4256d0645b tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:54.231188 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-6d982b5e-30d8-4b24-94ad-bd4256d0645b tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa" status: 200 len: 1405 microversion: 2.20 time: 0.284552 May 26 12:46:54.232459 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 77/141] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:46:53 2022] GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa => generated 1405 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:46:54.414483 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-05298c07-ae29-4bc1-a881-5638fbe5e4d6 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0537911b91184fcdbdcc9e93ec3fe5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad768b45d17480d8d6bbbcff6032c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:54.423043 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-05298c07-ae29-4bc1-a881-5638fbe5e4d6 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "GET /compute/v2.1/servers/1a852e3a-0d2b-470a-a429-b4bac6aa8e6b" status: 200 len: 1366 microversion: 2.1 time: 0.252454 May 26 12:46:54.432725 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-7e300c4e-e711-4157-9e04-719cf48b2aab tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:54.433449 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-7e300c4e-e711-4157-9e04-719cf48b2aab tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] [instance: d3b264dc-45ea-4e2f-8e62-42f1b7424d50] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:54.435960 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 65/142] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:46:54 2022] GET /compute/v2.1/servers/1a852e3a-0d2b-470a-a429-b4bac6aa8e6b => generated 1366 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:46:54.439868 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-7e300c4e-e711-4157-9e04-719cf48b2aab tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:54.440319 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-7e300c4e-e711-4157-9e04-719cf48b2aab tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:54.441229 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-7e300c4e-e711-4157-9e04-719cf48b2aab tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:54.441695 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-7e300c4e-e711-4157-9e04-719cf48b2aab tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:54.633926 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-dd0ed3e9-7f27-416a-8cc2-ac208cdc1781 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:54.635284 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-dd0ed3e9-7f27-416a-8cc2-ac208cdc1781 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: a442ae3a-5311-4f8f-acf3-08ce1534c9ea] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:54.661555 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-dd0ed3e9-7f27-416a-8cc2-ac208cdc1781 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:54.662042 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-dd0ed3e9-7f27-416a-8cc2-ac208cdc1781 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:54.670176 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-dd0ed3e9-7f27-416a-8cc2-ac208cdc1781 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:54.674908 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-dd0ed3e9-7f27-416a-8cc2-ac208cdc1781 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:54.816261 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-7e300c4e-e711-4157-9e04-719cf48b2aab tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d380efbe8c44fb3bbc58c9913cb25e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd0ea68fb8a43e886d0c9722d766ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:54.857191 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-7e300c4e-e711-4157-9e04-719cf48b2aab tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] 10.222.0.41 "GET /compute/v2.1/servers/d3b264dc-45ea-4e2f-8e62-42f1b7424d50" status: 200 len: 1314 microversion: 2.1 time: 0.426350 May 26 12:46:54.862827 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 78/143] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:46:54 2022] GET /compute/v2.1/servers/d3b264dc-45ea-4e2f-8e62-42f1b7424d50 => generated 1314 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:46:54.896960 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-dd0ed3e9-7f27-416a-8cc2-ac208cdc1781 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:54.907374 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-dd0ed3e9-7f27-416a-8cc2-ac208cdc1781 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea" status: 200 len: 1321 microversion: 2.1 time: 0.280757 May 26 12:46:54.908580 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 66/144] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:46:54 2022] GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea => generated 1321 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:46:55.249791 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-486044b5-b2dc-43e8-bd7b-bdf0cec817aa tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:55.250366 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-486044b5-b2dc-43e8-bd7b-bdf0cec817aa tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 7ffbf048-2aa0-4656-a6cd-923b35031eaa] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:55.256706 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-486044b5-b2dc-43e8-bd7b-bdf0cec817aa tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:55.257146 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-486044b5-b2dc-43e8-bd7b-bdf0cec817aa tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:55.258452 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-486044b5-b2dc-43e8-bd7b-bdf0cec817aa tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:55.258887 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-486044b5-b2dc-43e8-bd7b-bdf0cec817aa tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:55.391714 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-486044b5-b2dc-43e8-bd7b-bdf0cec817aa tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:55.414989 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-486044b5-b2dc-43e8-bd7b-bdf0cec817aa tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:55.419594 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-486044b5-b2dc-43e8-bd7b-bdf0cec817aa tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:55.421733 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-486044b5-b2dc-43e8-bd7b-bdf0cec817aa tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa" status: 200 len: 1405 microversion: 2.20 time: 0.175812 May 26 12:46:55.423019 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 79/145] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:46:55 2022] GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa => generated 1405 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:46:55.453128 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-9168c3e2-2cb2-432c-9151-01f56618f6f8 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:55.455205 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-9168c3e2-2cb2-432c-9151-01f56618f6f8 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: 1a852e3a-0d2b-470a-a429-b4bac6aa8e6b] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:55.462373 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-9168c3e2-2cb2-432c-9151-01f56618f6f8 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:55.463026 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-9168c3e2-2cb2-432c-9151-01f56618f6f8 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:55.466224 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-9168c3e2-2cb2-432c-9151-01f56618f6f8 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:55.466224 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-9168c3e2-2cb2-432c-9151-01f56618f6f8 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:55.518243 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG dbcounter [-] [124824] Writing DB stats nova_cell1:SELECT=100 {{(pid=124824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:46:55.632374 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-9168c3e2-2cb2-432c-9151-01f56618f6f8 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0537911b91184fcdbdcc9e93ec3fe5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad768b45d17480d8d6bbbcff6032c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:55.648239 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-9168c3e2-2cb2-432c-9151-01f56618f6f8 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "GET /compute/v2.1/servers/1a852e3a-0d2b-470a-a429-b4bac6aa8e6b" status: 200 len: 1366 microversion: 2.1 time: 0.207360 May 26 12:46:55.648763 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 67/146] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:46:55 2022] GET /compute/v2.1/servers/1a852e3a-0d2b-470a-a429-b4bac6aa8e6b => generated 1366 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:46:55.875581 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-26cd35b3-8a40-4b4b-8b7c-e3ffd184d906 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:55.876833 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-26cd35b3-8a40-4b4b-8b7c-e3ffd184d906 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] [instance: d3b264dc-45ea-4e2f-8e62-42f1b7424d50] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:55.885794 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-26cd35b3-8a40-4b4b-8b7c-e3ffd184d906 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:55.886246 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-26cd35b3-8a40-4b4b-8b7c-e3ffd184d906 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:55.887020 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-26cd35b3-8a40-4b4b-8b7c-e3ffd184d906 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:55.887499 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-26cd35b3-8a40-4b4b-8b7c-e3ffd184d906 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:55.925044 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-0fb62d5e-f0e3-4c47-a856-576d424c8b48 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:55.926091 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-0fb62d5e-f0e3-4c47-a856-576d424c8b48 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: a442ae3a-5311-4f8f-acf3-08ce1534c9ea] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:55.938848 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-0fb62d5e-f0e3-4c47-a856-576d424c8b48 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:55.939317 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-0fb62d5e-f0e3-4c47-a856-576d424c8b48 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:55.941504 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-0fb62d5e-f0e3-4c47-a856-576d424c8b48 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:55.942242 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-0fb62d5e-f0e3-4c47-a856-576d424c8b48 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:56.141778 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-26cd35b3-8a40-4b4b-8b7c-e3ffd184d906 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d380efbe8c44fb3bbc58c9913cb25e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd0ea68fb8a43e886d0c9722d766ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:56.151702 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-26cd35b3-8a40-4b4b-8b7c-e3ffd184d906 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] 10.222.0.41 "GET /compute/v2.1/servers/d3b264dc-45ea-4e2f-8e62-42f1b7424d50" status: 200 len: 1314 microversion: 2.1 time: 0.280960 May 26 12:46:56.163359 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 80/147] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:46:55 2022] GET /compute/v2.1/servers/d3b264dc-45ea-4e2f-8e62-42f1b7424d50 => generated 1314 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:46:56.207039 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-0fb62d5e-f0e3-4c47-a856-576d424c8b48 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:56.216215 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-0fb62d5e-f0e3-4c47-a856-576d424c8b48 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea" status: 200 len: 1321 microversion: 2.1 time: 0.295323 May 26 12:46:56.216767 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 68/148] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:46:55 2022] GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea => generated 1321 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:46:56.256132 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [req-97181840-5029-49cc-b8a1-4d305528380b req-9c0dbc19-2d4f-4112-81b1-28c148c8d62a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ffbf048-2aa0-4656-a6cd-923b35031eaa", "name": "network-vif-plugged", "status": "completed", "tag": "979ef417-a463-49c2-a7ae-7fae04d77dd9"}]} {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:46:56.269268 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [req-97181840-5029-49cc-b8a1-4d305528380b req-9c0dbc19-2d4f-4112-81b1-28c148c8d62a service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:56.270336 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [req-97181840-5029-49cc-b8a1-4d305528380b req-9c0dbc19-2d4f-4112-81b1-28c148c8d62a service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:56.283033 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.compute.server_external_events [req-97181840-5029-49cc-b8a1-4d305528380b req-9c0dbc19-2d4f-4112-81b1-28c148c8d62a service nova] Creating event network-vif-plugged:979ef417-a463-49c2-a7ae-7fae04d77dd9 for instance 7ffbf048-2aa0-4656-a6cd-923b35031eaa on hv-cinder-81571 May 26 12:46:56.288751 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [req-97181840-5029-49cc-b8a1-4d305528380b req-9c0dbc19-2d4f-4112-81b1-28c148c8d62a service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038070 May 26 12:46:56.289386 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 81/149] 10.222.0.41 () {64 vars in 1317 bytes} [Thu May 26 12:46:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:46:56.441571 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-72489457-a4de-460e-8174-030edfa6ecdc tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:56.443103 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-72489457-a4de-460e-8174-030edfa6ecdc tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 7ffbf048-2aa0-4656-a6cd-923b35031eaa] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:56.451953 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-72489457-a4de-460e-8174-030edfa6ecdc tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:56.452671 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-72489457-a4de-460e-8174-030edfa6ecdc tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:56.453833 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-72489457-a4de-460e-8174-030edfa6ecdc tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:56.454915 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-72489457-a4de-460e-8174-030edfa6ecdc tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:56.626474 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-72489457-a4de-460e-8174-030edfa6ecdc tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:56.640628 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-72489457-a4de-460e-8174-030edfa6ecdc tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:56.642317 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-72489457-a4de-460e-8174-030edfa6ecdc tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:56.643533 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-72489457-a4de-460e-8174-030edfa6ecdc tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa" status: 200 len: 1405 microversion: 2.20 time: 0.207131 May 26 12:46:56.644096 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 69/150] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:46:56 2022] GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa => generated 1405 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:46:56.666429 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-8d26ec4f-75e1-4822-b643-335d0e2d5049 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:56.667156 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-8d26ec4f-75e1-4822-b643-335d0e2d5049 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: 1a852e3a-0d2b-470a-a429-b4bac6aa8e6b] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:56.673541 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-8d26ec4f-75e1-4822-b643-335d0e2d5049 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:56.674024 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-8d26ec4f-75e1-4822-b643-335d0e2d5049 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:56.674792 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-8d26ec4f-75e1-4822-b643-335d0e2d5049 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:56.675382 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-8d26ec4f-75e1-4822-b643-335d0e2d5049 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:56.684961 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG dbcounter [-] [124823] Writing DB stats nova_cell1:SELECT=100 {{(pid=124823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:46:56.849511 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-8d26ec4f-75e1-4822-b643-335d0e2d5049 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0537911b91184fcdbdcc9e93ec3fe5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad768b45d17480d8d6bbbcff6032c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:56.858512 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-8d26ec4f-75e1-4822-b643-335d0e2d5049 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "GET /compute/v2.1/servers/1a852e3a-0d2b-470a-a429-b4bac6aa8e6b" status: 200 len: 1366 microversion: 2.1 time: 0.197453 May 26 12:46:56.859466 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 82/151] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:46:56 2022] GET /compute/v2.1/servers/1a852e3a-0d2b-470a-a429-b4bac6aa8e6b => generated 1366 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:46:57.170865 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-f35b0b06-76c7-4a44-85ef-d0c2a9d5f7c8 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:57.171728 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-f35b0b06-76c7-4a44-85ef-d0c2a9d5f7c8 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] [instance: d3b264dc-45ea-4e2f-8e62-42f1b7424d50] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:57.173618 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG dbcounter [-] [124824] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:46:57.179068 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-f35b0b06-76c7-4a44-85ef-d0c2a9d5f7c8 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:57.179550 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-f35b0b06-76c7-4a44-85ef-d0c2a9d5f7c8 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:57.180324 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-f35b0b06-76c7-4a44-85ef-d0c2a9d5f7c8 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:57.180805 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-f35b0b06-76c7-4a44-85ef-d0c2a9d5f7c8 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:57.239716 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-4981b1c7-752a-4c2a-b398-88352f600495 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:57.242957 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-4981b1c7-752a-4c2a-b398-88352f600495 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: a442ae3a-5311-4f8f-acf3-08ce1534c9ea] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:57.250942 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-4981b1c7-752a-4c2a-b398-88352f600495 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:57.251691 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-4981b1c7-752a-4c2a-b398-88352f600495 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:57.252735 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-4981b1c7-752a-4c2a-b398-88352f600495 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:57.253386 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-4981b1c7-752a-4c2a-b398-88352f600495 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:57.352857 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-f35b0b06-76c7-4a44-85ef-d0c2a9d5f7c8 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d380efbe8c44fb3bbc58c9913cb25e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd0ea68fb8a43e886d0c9722d766ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:57.362176 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-f35b0b06-76c7-4a44-85ef-d0c2a9d5f7c8 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] 10.222.0.41 "GET /compute/v2.1/servers/d3b264dc-45ea-4e2f-8e62-42f1b7424d50" status: 200 len: 1501 microversion: 2.1 time: 0.195446 May 26 12:46:57.368601 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 70/152] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:46:57 2022] GET /compute/v2.1/servers/d3b264dc-45ea-4e2f-8e62-42f1b7424d50 => generated 1501 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:46:57.425259 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-4981b1c7-752a-4c2a-b398-88352f600495 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:57.437869 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-4981b1c7-752a-4c2a-b398-88352f600495 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea" status: 200 len: 1514 microversion: 2.1 time: 0.197300 May 26 12:46:57.437869 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 83/153] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:46:57 2022] GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea => generated 1514 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:46:57.452323 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-784a9f56-b235-4b98-9444-8809349d89cc tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:46:57.453371 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-784a9f56-b235-4b98-9444-8809349d89cc tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: a442ae3a-5311-4f8f-acf3-08ce1534c9ea] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:57.459992 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-784a9f56-b235-4b98-9444-8809349d89cc tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:57.460574 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-784a9f56-b235-4b98-9444-8809349d89cc tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:57.461847 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-784a9f56-b235-4b98-9444-8809349d89cc tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:57.462282 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-784a9f56-b235-4b98-9444-8809349d89cc tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:57.525394 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.objects.instance [None req-784a9f56-b235-4b98-9444-8809349d89cc tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lazy-loading 'flavor' on Instance uuid a442ae3a-5311-4f8f-acf3-08ce1534c9ea {{(pid=124824) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:46:57.666388 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-3b8abffc-d541-45f2-9e1f-f0fd82c53e2d tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:57.667263 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-3b8abffc-d541-45f2-9e1f-f0fd82c53e2d tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 7ffbf048-2aa0-4656-a6cd-923b35031eaa] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:57.677785 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-3b8abffc-d541-45f2-9e1f-f0fd82c53e2d tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:57.677785 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-3b8abffc-d541-45f2-9e1f-f0fd82c53e2d tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:57.677785 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-3b8abffc-d541-45f2-9e1f-f0fd82c53e2d tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:57.678247 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-3b8abffc-d541-45f2-9e1f-f0fd82c53e2d tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:57.874474 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-3b8abffc-d541-45f2-9e1f-f0fd82c53e2d tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:57.882575 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-3b8abffc-d541-45f2-9e1f-f0fd82c53e2d tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:57.885076 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-3b8abffc-d541-45f2-9e1f-f0fd82c53e2d tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:57.887063 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-3b8abffc-d541-45f2-9e1f-f0fd82c53e2d tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa" status: 200 len: 1405 microversion: 2.20 time: 0.229164 May 26 12:46:57.887780 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 84/154] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:46:57 2022] GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa => generated 1405 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:46:57.892504 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-e467034c-2353-45d0-9258-fbac913be7b4 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:57.893114 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-e467034c-2353-45d0-9258-fbac913be7b4 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: 1a852e3a-0d2b-470a-a429-b4bac6aa8e6b] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:57.899928 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-e467034c-2353-45d0-9258-fbac913be7b4 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:57.901346 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-e467034c-2353-45d0-9258-fbac913be7b4 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:57.901346 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-e467034c-2353-45d0-9258-fbac913be7b4 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:57.901535 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-e467034c-2353-45d0-9258-fbac913be7b4 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:57.932799 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-784a9f56-b235-4b98-9444-8809349d89cc tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "POST /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea/action" status: 200 len: 32 microversion: 2.1 time: 0.484129 May 26 12:46:57.933614 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 71/155] 10.222.0.41 () {60 vars in 1277 bytes} [Thu May 26 12:46:57 2022] POST /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea/action => generated 32 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 12:46:57.948854 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-5b48703d-a936-4530-8766-b238ad7fa30a tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:57.959249 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-5b48703d-a936-4530-8766-b238ad7fa30a tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: a442ae3a-5311-4f8f-acf3-08ce1534c9ea] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:57.965417 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-5b48703d-a936-4530-8766-b238ad7fa30a tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:57.965911 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-5b48703d-a936-4530-8766-b238ad7fa30a tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:57.966943 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-5b48703d-a936-4530-8766-b238ad7fa30a tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:57.968968 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-5b48703d-a936-4530-8766-b238ad7fa30a tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:58.064307 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-e467034c-2353-45d0-9258-fbac913be7b4 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0537911b91184fcdbdcc9e93ec3fe5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad768b45d17480d8d6bbbcff6032c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:58.073140 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-e467034c-2353-45d0-9258-fbac913be7b4 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "GET /compute/v2.1/servers/1a852e3a-0d2b-470a-a429-b4bac6aa8e6b" status: 200 len: 1555 microversion: 2.1 time: 0.184430 May 26 12:46:58.073951 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 85/156] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:46:57 2022] GET /compute/v2.1/servers/1a852e3a-0d2b-470a-a429-b4bac6aa8e6b => generated 1555 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:46:58.099725 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-a4d950bb-e59b-4ec0-98b1-efac5093c666 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:58.099725 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-a4d950bb-e59b-4ec0-98b1-efac5093c666 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: 1a852e3a-0d2b-470a-a429-b4bac6aa8e6b] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:58.119377 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-a4d950bb-e59b-4ec0-98b1-efac5093c666 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:58.119834 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-a4d950bb-e59b-4ec0-98b1-efac5093c666 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:58.121083 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-a4d950bb-e59b-4ec0-98b1-efac5093c666 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:58.121534 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-a4d950bb-e59b-4ec0-98b1-efac5093c666 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:58.261740 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-a4d950bb-e59b-4ec0-98b1-efac5093c666 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "GET /compute/v2.1/servers/1a852e3a-0d2b-470a-a429-b4bac6aa8e6b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.167427 May 26 12:46:58.261740 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 86/157] 10.222.0.41 () {58 vars in 1274 bytes} [Thu May 26 12:46:58 2022] GET /compute/v2.1/servers/1a852e3a-0d2b-470a-a429-b4bac6aa8e6b/os-interface => generated 284 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:46:58.363255 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-5b48703d-a936-4530-8766-b238ad7fa30a tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:58.371926 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-5b48703d-a936-4530-8766-b238ad7fa30a tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea" status: 200 len: 1520 microversion: 2.1 time: 0.430328 May 26 12:46:58.372512 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 72/158] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:46:57 2022] GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea => generated 1520 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:46:58.912870 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-c3db323f-ea3a-438d-9711-f888688ff432 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:58.912870 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-c3db323f-ea3a-438d-9711-f888688ff432 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 7ffbf048-2aa0-4656-a6cd-923b35031eaa] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:58.916450 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-c3db323f-ea3a-438d-9711-f888688ff432 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:58.917427 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-c3db323f-ea3a-438d-9711-f888688ff432 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:58.918321 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-c3db323f-ea3a-438d-9711-f888688ff432 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:58.919000 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-c3db323f-ea3a-438d-9711-f888688ff432 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:59.195072 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-c3db323f-ea3a-438d-9711-f888688ff432 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:59.204884 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-c3db323f-ea3a-438d-9711-f888688ff432 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:59.206477 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-c3db323f-ea3a-438d-9711-f888688ff432 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:59.207729 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-c3db323f-ea3a-438d-9711-f888688ff432 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa" status: 200 len: 1405 microversion: 2.20 time: 0.303928 May 26 12:46:59.208403 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 87/159] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:46:58 2022] GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa => generated 1405 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:46:59.401964 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-c13ef228-c4a6-4b97-a7c2-95b86e499748 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:46:59.404381 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-c13ef228-c4a6-4b97-a7c2-95b86e499748 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: a442ae3a-5311-4f8f-acf3-08ce1534c9ea] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:46:59.431877 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-c13ef228-c4a6-4b97-a7c2-95b86e499748 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:59.436048 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-c13ef228-c4a6-4b97-a7c2-95b86e499748 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:59.438979 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-c13ef228-c4a6-4b97-a7c2-95b86e499748 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:46:59.440732 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-c13ef228-c4a6-4b97-a7c2-95b86e499748 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:46:59.611976 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-c13ef228-c4a6-4b97-a7c2-95b86e499748 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:46:59.622442 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-c13ef228-c4a6-4b97-a7c2-95b86e499748 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea" status: 200 len: 1520 microversion: 2.1 time: 0.235215 May 26 12:46:59.623042 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 73/160] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:46:59 2022] GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea => generated 1520 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:00.076942 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-47559de3-e029-40ee-ae8f-6b2155b633a7 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "637e2e0a-5d7a-4dc0-ad0c-dc78e89aad63"}} {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:47:00.078215 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-47559de3-e029-40ee-ae8f-6b2155b633a7 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] [instance: d3b264dc-45ea-4e2f-8e62-42f1b7424d50] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:00.086996 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-47559de3-e029-40ee-ae8f-6b2155b633a7 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:00.087502 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-47559de3-e029-40ee-ae8f-6b2155b633a7 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:00.088288 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-47559de3-e029-40ee-ae8f-6b2155b633a7 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:00.098535 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-47559de3-e029-40ee-ae8f-6b2155b633a7 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:00.193214 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [req-62c11b2c-74d9-4606-ba84-3511a656f8a1 req-ce737d24-f87a-4094-8998-696c59aaf474 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a852e3a-0d2b-470a-a429-b4bac6aa8e6b", "tag": "3cc1e56f-c372-4659-9acb-1c70403e8a78"}]} {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:47:00.202731 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [req-62c11b2c-74d9-4606-ba84-3511a656f8a1 req-ce737d24-f87a-4094-8998-696c59aaf474 service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:00.202731 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [req-62c11b2c-74d9-4606-ba84-3511a656f8a1 req-ce737d24-f87a-4094-8998-696c59aaf474 service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:00.214400 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.compute.server_external_events [req-62c11b2c-74d9-4606-ba84-3511a656f8a1 req-ce737d24-f87a-4094-8998-696c59aaf474 service nova] Creating event network-changed:3cc1e56f-c372-4659-9acb-1c70403e8a78 for instance 1a852e3a-0d2b-470a-a429-b4bac6aa8e6b on hv-cinder-81571 May 26 12:47:00.219964 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [req-62c11b2c-74d9-4606-ba84-3511a656f8a1 req-ce737d24-f87a-4094-8998-696c59aaf474 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030397 May 26 12:47:00.220900 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 74/161] 10.222.0.41 () {64 vars in 1317 bytes} [Thu May 26 12:47:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:47:00.227589 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-88400b3f-4c58-4197-a4e5-4794af565510 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:00.228326 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-88400b3f-4c58-4197-a4e5-4794af565510 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 7ffbf048-2aa0-4656-a6cd-923b35031eaa] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:00.236159 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-88400b3f-4c58-4197-a4e5-4794af565510 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:00.244670 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-88400b3f-4c58-4197-a4e5-4794af565510 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:00.244670 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-88400b3f-4c58-4197-a4e5-4794af565510 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:00.244670 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-88400b3f-4c58-4197-a4e5-4794af565510 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:00.581531 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-88400b3f-4c58-4197-a4e5-4794af565510 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:00.590209 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-88400b3f-4c58-4197-a4e5-4794af565510 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:00.591816 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-88400b3f-4c58-4197-a4e5-4794af565510 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:00.598340 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-88400b3f-4c58-4197-a4e5-4794af565510 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa" status: 200 len: 1598 microversion: 2.20 time: 0.376247 May 26 12:47:00.616209 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 75/162] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:47:00 2022] GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa => generated 1598 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:47:00.628006 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-0a189366-0511-470f-af4f-a7a880daf780 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:00.628787 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-0a189366-0511-470f-af4f-a7a880daf780 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 7ffbf048-2aa0-4656-a6cd-923b35031eaa] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:00.645487 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-0a189366-0511-470f-af4f-a7a880daf780 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:00.647033 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-0a189366-0511-470f-af4f-a7a880daf780 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:00.647883 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-0a189366-0511-470f-af4f-a7a880daf780 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:00.648415 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-0a189366-0511-470f-af4f-a7a880daf780 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:00.777086 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-0a189366-0511-470f-af4f-a7a880daf780 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.158845 May 26 12:47:00.778348 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 76/163] 10.222.0.41 () {60 vars in 1315 bytes} [Thu May 26 12:47:00 2022] GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa/os-interface => generated 285 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 12:47:00.783808 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-150ec263-c70a-46cb-8968-58dcadc585b3 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:00.785109 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-150ec263-c70a-46cb-8968-58dcadc585b3 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: a442ae3a-5311-4f8f-acf3-08ce1534c9ea] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:00.800192 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-150ec263-c70a-46cb-8968-58dcadc585b3 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:00.800192 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-150ec263-c70a-46cb-8968-58dcadc585b3 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:00.802451 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-150ec263-c70a-46cb-8968-58dcadc585b3 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:00.803310 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-150ec263-c70a-46cb-8968-58dcadc585b3 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:01.213651 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-150ec263-c70a-46cb-8968-58dcadc585b3 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:01.227057 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-150ec263-c70a-46cb-8968-58dcadc585b3 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea" status: 200 len: 1520 microversion: 2.1 time: 0.447306 May 26 12:47:01.233655 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 77/164] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:47:00 2022] GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea => generated 1520 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:01.651839 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-47559de3-e029-40ee-ae8f-6b2155b633a7 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] 10.222.0.41 "POST /compute/v2.1/servers/d3b264dc-45ea-4e2f-8e62-42f1b7424d50/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.579038 May 26 12:47:01.653961 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 88/165] 10.222.0.41 () {60 vars in 1322 bytes} [Thu May 26 12:47:00 2022] POST /compute/v2.1/servers/d3b264dc-45ea-4e2f-8e62-42f1b7424d50/os-volume_attachments => generated 194 bytes in 1582 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:47:02.239278 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [req-843d7ce0-7e10-4a05-8448-875bf7b26629 req-935f76c9-d47f-4807-81c2-6261925120d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ffbf048-2aa0-4656-a6cd-923b35031eaa", "tag": "979ef417-a463-49c2-a7ae-7fae04d77dd9"}]} {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:47:02.247125 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-6e46f359-a12c-4244-bc1a-80f297f2b607 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:02.248095 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [req-843d7ce0-7e10-4a05-8448-875bf7b26629 req-935f76c9-d47f-4807-81c2-6261925120d9 service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:02.248475 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-6e46f359-a12c-4244-bc1a-80f297f2b607 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: a442ae3a-5311-4f8f-acf3-08ce1534c9ea] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:02.248583 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [req-843d7ce0-7e10-4a05-8448-875bf7b26629 req-935f76c9-d47f-4807-81c2-6261925120d9 service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:02.257031 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-6e46f359-a12c-4244-bc1a-80f297f2b607 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:02.257759 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-6e46f359-a12c-4244-bc1a-80f297f2b607 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:02.258754 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-6e46f359-a12c-4244-bc1a-80f297f2b607 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:02.259388 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-6e46f359-a12c-4244-bc1a-80f297f2b607 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:02.261187 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.compute.server_external_events [req-843d7ce0-7e10-4a05-8448-875bf7b26629 req-935f76c9-d47f-4807-81c2-6261925120d9 service nova] Creating event network-changed:979ef417-a463-49c2-a7ae-7fae04d77dd9 for instance 7ffbf048-2aa0-4656-a6cd-923b35031eaa on hv-cinder-81571 May 26 12:47:02.268216 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [req-843d7ce0-7e10-4a05-8448-875bf7b26629 req-935f76c9-d47f-4807-81c2-6261925120d9 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032992 May 26 12:47:02.269550 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 78/166] 10.222.0.41 () {64 vars in 1317 bytes} [Thu May 26 12:47:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:47:02.441599 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-6e46f359-a12c-4244-bc1a-80f297f2b607 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:02.449889 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-6e46f359-a12c-4244-bc1a-80f297f2b607 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea" status: 200 len: 1520 microversion: 2.1 time: 0.207212 May 26 12:47:02.459018 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 89/167] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:47:02 2022] GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea => generated 1520 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:03.466814 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-da2bebe7-0258-4886-8ea9-6abd8d143d14 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:03.468340 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-da2bebe7-0258-4886-8ea9-6abd8d143d14 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: a442ae3a-5311-4f8f-acf3-08ce1534c9ea] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:03.478138 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-da2bebe7-0258-4886-8ea9-6abd8d143d14 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:03.478593 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-da2bebe7-0258-4886-8ea9-6abd8d143d14 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:03.479553 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-da2bebe7-0258-4886-8ea9-6abd8d143d14 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:03.480245 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-da2bebe7-0258-4886-8ea9-6abd8d143d14 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:03.633690 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-da2bebe7-0258-4886-8ea9-6abd8d143d14 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:03.641239 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-da2bebe7-0258-4886-8ea9-6abd8d143d14 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea" status: 200 len: 1520 microversion: 2.1 time: 0.178662 May 26 12:47:03.644345 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 79/168] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:47:03 2022] GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea => generated 1520 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:04.660685 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-fe16814a-f15d-4e1b-8917-2e411fae9d80 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:04.662207 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-fe16814a-f15d-4e1b-8917-2e411fae9d80 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: a442ae3a-5311-4f8f-acf3-08ce1534c9ea] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:04.671224 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-fe16814a-f15d-4e1b-8917-2e411fae9d80 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:04.671788 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-fe16814a-f15d-4e1b-8917-2e411fae9d80 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:04.672573 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-fe16814a-f15d-4e1b-8917-2e411fae9d80 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:04.673189 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-fe16814a-f15d-4e1b-8917-2e411fae9d80 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:05.164528 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-fe16814a-f15d-4e1b-8917-2e411fae9d80 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:05.174861 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-fe16814a-f15d-4e1b-8917-2e411fae9d80 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea" status: 200 len: 1520 microversion: 2.1 time: 0.520268 May 26 12:47:05.175767 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 90/169] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:47:04 2022] GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea => generated 1520 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:06.192489 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-ea441201-21bb-4f8a-8e41-d2070f92ab36 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:06.193127 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-ea441201-21bb-4f8a-8e41-d2070f92ab36 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: a442ae3a-5311-4f8f-acf3-08ce1534c9ea] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:06.200015 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-ea441201-21bb-4f8a-8e41-d2070f92ab36 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:06.200481 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-ea441201-21bb-4f8a-8e41-d2070f92ab36 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:06.201312 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-ea441201-21bb-4f8a-8e41-d2070f92ab36 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:06.201627 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-ea441201-21bb-4f8a-8e41-d2070f92ab36 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:06.392701 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-ea441201-21bb-4f8a-8e41-d2070f92ab36 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:06.404606 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-ea441201-21bb-4f8a-8e41-d2070f92ab36 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea" status: 200 len: 1520 microversion: 2.1 time: 0.216180 May 26 12:47:06.405337 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 80/170] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:47:06 2022] GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea => generated 1520 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:07.422498 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-5383bb02-a8a4-490b-bf70-c6ce5b525ffd tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:07.423117 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-5383bb02-a8a4-490b-bf70-c6ce5b525ffd tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: a442ae3a-5311-4f8f-acf3-08ce1534c9ea] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:07.430293 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-5383bb02-a8a4-490b-bf70-c6ce5b525ffd tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:07.430741 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-5383bb02-a8a4-490b-bf70-c6ce5b525ffd tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:07.431521 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-5383bb02-a8a4-490b-bf70-c6ce5b525ffd tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:07.431952 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-5383bb02-a8a4-490b-bf70-c6ce5b525ffd tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:07.614815 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-5383bb02-a8a4-490b-bf70-c6ce5b525ffd tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:07.624349 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-5383bb02-a8a4-490b-bf70-c6ce5b525ffd tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea" status: 200 len: 1520 microversion: 2.1 time: 0.205796 May 26 12:47:07.624939 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 91/171] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:47:07 2022] GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea => generated 1520 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:08.641953 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-5c6c06fa-5d0f-456e-bda5-c1038c3b0261 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:08.642579 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-5c6c06fa-5d0f-456e-bda5-c1038c3b0261 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: a442ae3a-5311-4f8f-acf3-08ce1534c9ea] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:08.661751 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-5c6c06fa-5d0f-456e-bda5-c1038c3b0261 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:08.662497 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-5c6c06fa-5d0f-456e-bda5-c1038c3b0261 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:08.663450 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-5c6c06fa-5d0f-456e-bda5-c1038c3b0261 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:08.664087 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-5c6c06fa-5d0f-456e-bda5-c1038c3b0261 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:08.882385 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-5c6c06fa-5d0f-456e-bda5-c1038c3b0261 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:08.890001 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-5c6c06fa-5d0f-456e-bda5-c1038c3b0261 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea" status: 200 len: 1520 microversion: 2.1 time: 0.251911 May 26 12:47:08.899382 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 81/172] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:47:08 2022] GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea => generated 1520 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:09.910262 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-c4fdf70a-a746-4af6-9534-a203be9e6826 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:09.910714 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-c4fdf70a-a746-4af6-9534-a203be9e6826 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: a442ae3a-5311-4f8f-acf3-08ce1534c9ea] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:09.913191 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG dbcounter [-] [124823] Writing DB stats nova_api:SELECT=82 {{(pid=124823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:09.918452 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-c4fdf70a-a746-4af6-9534-a203be9e6826 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:09.918907 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-c4fdf70a-a746-4af6-9534-a203be9e6826 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:09.919721 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-c4fdf70a-a746-4af6-9534-a203be9e6826 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:09.920155 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-c4fdf70a-a746-4af6-9534-a203be9e6826 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:10.098038 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-c4fdf70a-a746-4af6-9534-a203be9e6826 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:10.111778 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-c4fdf70a-a746-4af6-9534-a203be9e6826 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea" status: 200 len: 1520 microversion: 2.1 time: 0.208633 May 26 12:47:10.112444 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 92/173] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:47:09 2022] GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea => generated 1520 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:11.129036 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-299ab2df-59cb-4c48-b708-74fa3aa739f4 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:11.129590 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-299ab2df-59cb-4c48-b708-74fa3aa739f4 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: a442ae3a-5311-4f8f-acf3-08ce1534c9ea] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:11.136783 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-299ab2df-59cb-4c48-b708-74fa3aa739f4 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:11.137256 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-299ab2df-59cb-4c48-b708-74fa3aa739f4 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:11.138111 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-299ab2df-59cb-4c48-b708-74fa3aa739f4 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:11.138548 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-299ab2df-59cb-4c48-b708-74fa3aa739f4 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:11.271578 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-299ab2df-59cb-4c48-b708-74fa3aa739f4 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:11.279449 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-299ab2df-59cb-4c48-b708-74fa3aa739f4 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea" status: 200 len: 1520 microversion: 2.1 time: 0.154651 May 26 12:47:11.280026 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 82/174] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:47:11 2022] GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:12.296716 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-6c6c2468-94f5-4542-8584-bf3994fb2342 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:12.297497 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-6c6c2468-94f5-4542-8584-bf3994fb2342 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: a442ae3a-5311-4f8f-acf3-08ce1534c9ea] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:12.304057 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-6c6c2468-94f5-4542-8584-bf3994fb2342 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:12.304539 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-6c6c2468-94f5-4542-8584-bf3994fb2342 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:12.305301 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-6c6c2468-94f5-4542-8584-bf3994fb2342 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:12.305778 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-6c6c2468-94f5-4542-8584-bf3994fb2342 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:12.438083 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-6c6c2468-94f5-4542-8584-bf3994fb2342 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:12.446813 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-6c6c2468-94f5-4542-8584-bf3994fb2342 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea" status: 200 len: 1520 microversion: 2.1 time: 0.154215 May 26 12:47:12.447385 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 93/175] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:47:12 2022] GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:13.464194 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-7ea0e839-7bc6-4285-9d40-3ccfa6e798f2 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:13.465606 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-7ea0e839-7bc6-4285-9d40-3ccfa6e798f2 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: a442ae3a-5311-4f8f-acf3-08ce1534c9ea] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:13.475961 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-7ea0e839-7bc6-4285-9d40-3ccfa6e798f2 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:13.476651 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-7ea0e839-7bc6-4285-9d40-3ccfa6e798f2 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:13.477625 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-7ea0e839-7bc6-4285-9d40-3ccfa6e798f2 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:13.480532 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-7ea0e839-7bc6-4285-9d40-3ccfa6e798f2 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:13.626845 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-7ea0e839-7bc6-4285-9d40-3ccfa6e798f2 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:13.629927 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG dbcounter [-] [124824] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:13.637255 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-7ea0e839-7bc6-4285-9d40-3ccfa6e798f2 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea" status: 200 len: 1520 microversion: 2.1 time: 0.177503 May 26 12:47:13.646827 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 83/176] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:47:13 2022] GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea => generated 1520 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:14.654945 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-e43787f6-edae-449f-b271-83b20e7c08cc tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:14.655731 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-e43787f6-edae-449f-b271-83b20e7c08cc tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: a442ae3a-5311-4f8f-acf3-08ce1534c9ea] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:14.666406 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-e43787f6-edae-449f-b271-83b20e7c08cc tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:14.666587 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-e43787f6-edae-449f-b271-83b20e7c08cc tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:14.667415 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-e43787f6-edae-449f-b271-83b20e7c08cc tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:14.667811 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-e43787f6-edae-449f-b271-83b20e7c08cc tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:14.855913 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-e43787f6-edae-449f-b271-83b20e7c08cc tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:14.863850 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-e43787f6-edae-449f-b271-83b20e7c08cc tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea" status: 200 len: 1520 microversion: 2.1 time: 0.212851 May 26 12:47:14.864422 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 94/177] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:47:14 2022] GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea => generated 1520 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:47:15.880450 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-9773f0e4-22aa-44dc-81d3-e7573ec2ce22 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:15.881086 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-9773f0e4-22aa-44dc-81d3-e7573ec2ce22 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: a442ae3a-5311-4f8f-acf3-08ce1534c9ea] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:15.888253 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-9773f0e4-22aa-44dc-81d3-e7573ec2ce22 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:15.888702 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-9773f0e4-22aa-44dc-81d3-e7573ec2ce22 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:15.889465 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-9773f0e4-22aa-44dc-81d3-e7573ec2ce22 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:15.889996 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-9773f0e4-22aa-44dc-81d3-e7573ec2ce22 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:16.035929 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-9773f0e4-22aa-44dc-81d3-e7573ec2ce22 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:16.044216 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-9773f0e4-22aa-44dc-81d3-e7573ec2ce22 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea" status: 200 len: 1520 microversion: 2.1 time: 0.167825 May 26 12:47:16.055723 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 84/178] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:47:15 2022] GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:17.062130 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-fb9199c7-8bee-4db6-bd2f-8041bea8443c tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:17.062746 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-fb9199c7-8bee-4db6-bd2f-8041bea8443c tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: a442ae3a-5311-4f8f-acf3-08ce1534c9ea] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:17.069435 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-fb9199c7-8bee-4db6-bd2f-8041bea8443c tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:17.069969 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-fb9199c7-8bee-4db6-bd2f-8041bea8443c tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:17.070737 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-fb9199c7-8bee-4db6-bd2f-8041bea8443c tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:17.071172 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-fb9199c7-8bee-4db6-bd2f-8041bea8443c tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:17.197124 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-0fe74839-5f6f-4af6-a235-67cdf912bf43 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:17.202253 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-0fe74839-5f6f-4af6-a235-67cdf912bf43 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] [instance: d3b264dc-45ea-4e2f-8e62-42f1b7424d50] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:17.204376 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-0fe74839-5f6f-4af6-a235-67cdf912bf43 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:17.204817 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-0fe74839-5f6f-4af6-a235-67cdf912bf43 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:17.205639 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-0fe74839-5f6f-4af6-a235-67cdf912bf43 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:17.206034 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-0fe74839-5f6f-4af6-a235-67cdf912bf43 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:17.208933 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-fb9199c7-8bee-4db6-bd2f-8041bea8443c tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:17.217147 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-fb9199c7-8bee-4db6-bd2f-8041bea8443c tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea" status: 200 len: 1520 microversion: 2.1 time: 0.158853 May 26 12:47:17.218065 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 95/179] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:47:17 2022] GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:17.235967 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-0fe74839-5f6f-4af6-a235-67cdf912bf43 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] [instance: d3b264dc-45ea-4e2f-8e62-42f1b7424d50] Going to try to terminate instance {{(pid=124824) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 12:47:17.546732 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-0fe74839-5f6f-4af6-a235-67cdf912bf43 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] 10.222.0.41 "DELETE /compute/v2.1/servers/d3b264dc-45ea-4e2f-8e62-42f1b7424d50" status: 204 len: 0 microversion: 2.1 time: 0.353242 May 26 12:47:17.547750 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 85/180] 10.222.0.41 () {58 vars in 1238 bytes} [Thu May 26 12:47:17 2022] DELETE /compute/v2.1/servers/d3b264dc-45ea-4e2f-8e62-42f1b7424d50 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 26 12:47:17.555889 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-d0041f94-ab9e-406e-87d4-aacf410e27e8 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:17.556560 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-d0041f94-ab9e-406e-87d4-aacf410e27e8 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] [instance: d3b264dc-45ea-4e2f-8e62-42f1b7424d50] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:17.562874 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-d0041f94-ab9e-406e-87d4-aacf410e27e8 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:17.563457 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-d0041f94-ab9e-406e-87d4-aacf410e27e8 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:17.564537 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-d0041f94-ab9e-406e-87d4-aacf410e27e8 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:17.564965 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-d0041f94-ab9e-406e-87d4-aacf410e27e8 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:17.712358 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-d0041f94-ab9e-406e-87d4-aacf410e27e8 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d380efbe8c44fb3bbc58c9913cb25e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd0ea68fb8a43e886d0c9722d766ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:17.720996 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-d0041f94-ab9e-406e-87d4-aacf410e27e8 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] 10.222.0.41 "GET /compute/v2.1/servers/d3b264dc-45ea-4e2f-8e62-42f1b7424d50" status: 200 len: 1553 microversion: 2.1 time: 0.168894 May 26 12:47:17.721596 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 96/181] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:47:17 2022] GET /compute/v2.1/servers/d3b264dc-45ea-4e2f-8e62-42f1b7424d50 => generated 1553 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:18.235434 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-ca6492d6-2589-4aae-b9ff-0db95e865709 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:18.236150 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-ca6492d6-2589-4aae-b9ff-0db95e865709 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: a442ae3a-5311-4f8f-acf3-08ce1534c9ea] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:18.243432 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-ca6492d6-2589-4aae-b9ff-0db95e865709 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:18.244113 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-ca6492d6-2589-4aae-b9ff-0db95e865709 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:18.245252 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-ca6492d6-2589-4aae-b9ff-0db95e865709 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:18.246091 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-ca6492d6-2589-4aae-b9ff-0db95e865709 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:18.378108 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-ca6492d6-2589-4aae-b9ff-0db95e865709 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:18.387150 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-ca6492d6-2589-4aae-b9ff-0db95e865709 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea" status: 200 len: 1520 microversion: 2.1 time: 0.155940 May 26 12:47:18.387905 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 86/182] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:47:18 2022] GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:18.738044 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-49d116be-74f3-4c13-a973-3241e5b331db tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:18.738648 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-49d116be-74f3-4c13-a973-3241e5b331db tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] [instance: d3b264dc-45ea-4e2f-8e62-42f1b7424d50] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:18.745544 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-49d116be-74f3-4c13-a973-3241e5b331db tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:18.746092 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-49d116be-74f3-4c13-a973-3241e5b331db tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:18.746876 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-49d116be-74f3-4c13-a973-3241e5b331db tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:18.747274 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-49d116be-74f3-4c13-a973-3241e5b331db tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:18.892956 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-49d116be-74f3-4c13-a973-3241e5b331db tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d380efbe8c44fb3bbc58c9913cb25e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd0ea68fb8a43e886d0c9722d766ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:18.899504 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG dbcounter [-] [124823] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:18.902569 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-49d116be-74f3-4c13-a973-3241e5b331db tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] 10.222.0.41 "GET /compute/v2.1/servers/d3b264dc-45ea-4e2f-8e62-42f1b7424d50" status: 200 len: 1553 microversion: 2.1 time: 0.168587 May 26 12:47:18.906050 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 97/183] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:47:18 2022] GET /compute/v2.1/servers/d3b264dc-45ea-4e2f-8e62-42f1b7424d50 => generated 1553 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:19.405580 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-5480656a-3598-4b3c-83a9-a5cf7810b8e5 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:19.406298 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-5480656a-3598-4b3c-83a9-a5cf7810b8e5 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: a442ae3a-5311-4f8f-acf3-08ce1534c9ea] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:19.414460 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-5480656a-3598-4b3c-83a9-a5cf7810b8e5 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:19.414460 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-5480656a-3598-4b3c-83a9-a5cf7810b8e5 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:19.416408 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-5480656a-3598-4b3c-83a9-a5cf7810b8e5 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:19.416408 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-5480656a-3598-4b3c-83a9-a5cf7810b8e5 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:19.561574 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-5480656a-3598-4b3c-83a9-a5cf7810b8e5 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:19.578766 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-5480656a-3598-4b3c-83a9-a5cf7810b8e5 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea" status: 200 len: 1520 microversion: 2.1 time: 0.177704 May 26 12:47:19.579621 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 87/184] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:47:19 2022] GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea => generated 1520 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:47:19.920136 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-095e695a-5894-4a29-89dc-b9d4a8375415 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:19.920648 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-095e695a-5894-4a29-89dc-b9d4a8375415 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] [instance: d3b264dc-45ea-4e2f-8e62-42f1b7424d50] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:19.928144 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-095e695a-5894-4a29-89dc-b9d4a8375415 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:19.928591 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-095e695a-5894-4a29-89dc-b9d4a8375415 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:19.929434 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-095e695a-5894-4a29-89dc-b9d4a8375415 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:19.929810 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-095e695a-5894-4a29-89dc-b9d4a8375415 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:20.218452 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-095e695a-5894-4a29-89dc-b9d4a8375415 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d380efbe8c44fb3bbc58c9913cb25e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd0ea68fb8a43e886d0c9722d766ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:20.226589 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-095e695a-5894-4a29-89dc-b9d4a8375415 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] 10.222.0.41 "GET /compute/v2.1/servers/d3b264dc-45ea-4e2f-8e62-42f1b7424d50" status: 200 len: 1553 microversion: 2.1 time: 0.310585 May 26 12:47:20.227180 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 98/185] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:47:19 2022] GET /compute/v2.1/servers/d3b264dc-45ea-4e2f-8e62-42f1b7424d50 => generated 1553 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:20.597536 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-ef5df7bb-b8e8-4fb0-9871-d6f6d842b982 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:20.598247 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-ef5df7bb-b8e8-4fb0-9871-d6f6d842b982 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: a442ae3a-5311-4f8f-acf3-08ce1534c9ea] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:20.605325 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-ef5df7bb-b8e8-4fb0-9871-d6f6d842b982 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:20.605827 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-ef5df7bb-b8e8-4fb0-9871-d6f6d842b982 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:20.606549 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-ef5df7bb-b8e8-4fb0-9871-d6f6d842b982 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:20.607062 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-ef5df7bb-b8e8-4fb0-9871-d6f6d842b982 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:20.735646 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [req-d12328b0-5a7a-476a-b864-4b9cc6d8268f req-b2a5bdfc-2b01-408c-afe4-772dcaa00639 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3b264dc-45ea-4e2f-8e62-42f1b7424d50", "name": "network-vif-deleted", "tag": "44838f0a-08a0-4e0b-bb0c-fbfa649ef217"}]} {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:47:20.744909 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [req-d12328b0-5a7a-476a-b864-4b9cc6d8268f req-b2a5bdfc-2b01-408c-afe4-772dcaa00639 service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:20.745637 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [req-d12328b0-5a7a-476a-b864-4b9cc6d8268f req-b2a5bdfc-2b01-408c-afe4-772dcaa00639 service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:20.757839 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-ef5df7bb-b8e8-4fb0-9871-d6f6d842b982 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:20.765547 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-ef5df7bb-b8e8-4fb0-9871-d6f6d842b982 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea" status: 200 len: 1520 microversion: 2.1 time: 0.172049 May 26 12:47:20.766143 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 88/186] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:47:20 2022] GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:20.768762 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.compute.server_external_events [req-d12328b0-5a7a-476a-b864-4b9cc6d8268f req-b2a5bdfc-2b01-408c-afe4-772dcaa00639 service nova] Creating event network-vif-deleted:44838f0a-08a0-4e0b-bb0c-fbfa649ef217 for instance d3b264dc-45ea-4e2f-8e62-42f1b7424d50 on hv-cinder-81571 May 26 12:47:20.774515 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [req-d12328b0-5a7a-476a-b864-4b9cc6d8268f req-b2a5bdfc-2b01-408c-afe4-772dcaa00639 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041943 May 26 12:47:20.775117 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 99/187] 10.222.0.41 () {64 vars in 1317 bytes} [Thu May 26 12:47:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:47:21.259496 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-53a65abd-9b13-4b91-b13a-77cbc734e652 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:21.259496 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-53a65abd-9b13-4b91-b13a-77cbc734e652 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] [instance: d3b264dc-45ea-4e2f-8e62-42f1b7424d50] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:21.269146 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-53a65abd-9b13-4b91-b13a-77cbc734e652 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:21.276429 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-53a65abd-9b13-4b91-b13a-77cbc734e652 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:21.279814 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-53a65abd-9b13-4b91-b13a-77cbc734e652 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:21.281416 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-53a65abd-9b13-4b91-b13a-77cbc734e652 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:21.460014 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-53a65abd-9b13-4b91-b13a-77cbc734e652 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d380efbe8c44fb3bbc58c9913cb25e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd0ea68fb8a43e886d0c9722d766ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:21.491306 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-53a65abd-9b13-4b91-b13a-77cbc734e652 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] 10.222.0.41 "GET /compute/v2.1/servers/d3b264dc-45ea-4e2f-8e62-42f1b7424d50" status: 200 len: 1345 microversion: 2.1 time: 0.246903 May 26 12:47:21.493446 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 89/188] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:47:21 2022] GET /compute/v2.1/servers/d3b264dc-45ea-4e2f-8e62-42f1b7424d50 => generated 1345 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:47:21.797038 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-0d160281-7a4f-422d-9011-732e9b5e4079 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:21.798797 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-0d160281-7a4f-422d-9011-732e9b5e4079 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: a442ae3a-5311-4f8f-acf3-08ce1534c9ea] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:21.819935 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-0d160281-7a4f-422d-9011-732e9b5e4079 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:21.821293 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-0d160281-7a4f-422d-9011-732e9b5e4079 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:21.823461 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-0d160281-7a4f-422d-9011-732e9b5e4079 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:21.825834 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-0d160281-7a4f-422d-9011-732e9b5e4079 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:22.049565 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-0d160281-7a4f-422d-9011-732e9b5e4079 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:22.058096 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-0d160281-7a4f-422d-9011-732e9b5e4079 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea" status: 200 len: 1520 microversion: 2.1 time: 0.273435 May 26 12:47:22.058696 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 100/189] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:47:21 2022] GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea => generated 1520 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:22.526732 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-8f7a084a-c4f5-443a-bf55-149b8a18f505 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:22.527587 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-8f7a084a-c4f5-443a-bf55-149b8a18f505 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] [instance: d3b264dc-45ea-4e2f-8e62-42f1b7424d50] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:22.534230 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-8f7a084a-c4f5-443a-bf55-149b8a18f505 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:22.534685 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-8f7a084a-c4f5-443a-bf55-149b8a18f505 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:22.535649 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-8f7a084a-c4f5-443a-bf55-149b8a18f505 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:22.536426 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-8f7a084a-c4f5-443a-bf55-149b8a18f505 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:22.571101 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-8f7a084a-c4f5-443a-bf55-149b8a18f505 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:22.571271 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-8f7a084a-c4f5-443a-bf55-149b8a18f505 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:22.571618 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.objects.instance [None req-8f7a084a-c4f5-443a-bf55-149b8a18f505 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lazy-loading 'fault' on Instance uuid d3b264dc-45ea-4e2f-8e62-42f1b7424d50 {{(pid=124824) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:47:22.617249 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-8f7a084a-c4f5-443a-bf55-149b8a18f505 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d380efbe8c44fb3bbc58c9913cb25e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd0ea68fb8a43e886d0c9722d766ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:22.626138 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-8f7a084a-c4f5-443a-bf55-149b8a18f505 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] 10.222.0.41 "GET /compute/v2.1/servers/d3b264dc-45ea-4e2f-8e62-42f1b7424d50" status: 200 len: 1350 microversion: 2.1 time: 0.103353 May 26 12:47:22.626723 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 90/190] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:47:22 2022] GET /compute/v2.1/servers/d3b264dc-45ea-4e2f-8e62-42f1b7424d50 => generated 1350 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:47:23.075655 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-5ed42821-770c-42da-8bec-549b1188c519 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:23.076980 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-5ed42821-770c-42da-8bec-549b1188c519 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: a442ae3a-5311-4f8f-acf3-08ce1534c9ea] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:23.085185 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-5ed42821-770c-42da-8bec-549b1188c519 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:23.085654 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-5ed42821-770c-42da-8bec-549b1188c519 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:23.086451 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-5ed42821-770c-42da-8bec-549b1188c519 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:23.086880 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-5ed42821-770c-42da-8bec-549b1188c519 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:23.284625 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-5ed42821-770c-42da-8bec-549b1188c519 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:23.295475 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-5ed42821-770c-42da-8bec-549b1188c519 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea" status: 200 len: 1520 microversion: 2.1 time: 0.224126 May 26 12:47:23.296409 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 101/191] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:47:23 2022] GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea => generated 1520 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:23.644952 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-6910bcf4-92b6-4d61-b0be-8685c73a903e tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:23.646449 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-6910bcf4-92b6-4d61-b0be-8685c73a903e tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] [instance: d3b264dc-45ea-4e2f-8e62-42f1b7424d50] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:23.654800 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-6910bcf4-92b6-4d61-b0be-8685c73a903e tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:23.655503 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-6910bcf4-92b6-4d61-b0be-8685c73a903e tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:23.656495 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-6910bcf4-92b6-4d61-b0be-8685c73a903e tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:23.656933 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-6910bcf4-92b6-4d61-b0be-8685c73a903e tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:23.673750 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.wsgi [None req-6910bcf4-92b6-4d61-b0be-8685c73a903e tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] HTTP exception thrown: Instance d3b264dc-45ea-4e2f-8e62-42f1b7424d50 could not be found. May 26 12:47:23.677440 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-6910bcf4-92b6-4d61-b0be-8685c73a903e tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Request method failure captured: May 26 12:47:23.677440 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: request: GET /compute/v2.1/servers/d3b264dc-45ea-4e2f-8e62-42f1b7424d50 HTTP/1.1 May 26 12:47:23.677440 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Accept: application/json May 26 12:47:23.677440 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Accept-Encoding: identity May 26 12:47:23.677440 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Connection: close May 26 12:47:23.677440 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Content-Length: 0 May 26 12:47:23.677440 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Content-Type: application/json May 26 12:47:23.677440 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Host: 10.222.0.41 May 26 12:47:23.677440 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Openstack-System-Scope: None May 26 12:47:23.677440 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: User-Agent: python-urllib3/1.26.9 May 26 12:47:23.677440 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Auth-Token: gAAAAABij3aNXXsqN7z5ri-l8wO3Af084AG64gNcAfjP9VcWLp4rH-I2hKVHsG-nSqO0G3TyC_p839gAM6SmGG09Z1aENcPAAUtOWoR_QnBrByUu7_iqyZwsYLOrL7o6hXk2yx1U9Rh7kfHOdEuq6Qak0dzSKxAr5zGPZlupmC-6m4T0d5eJVhQ May 26 12:47:23.677440 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Domain-Id: None May 26 12:47:23.677440 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Domain-Name: None May 26 12:47:23.677440 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Identity-Status: Confirmed May 26 12:47:23.677440 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Is-Admin-Project: True May 26 12:47:23.677440 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Domain-Id: default May 26 12:47:23.677440 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Domain-Name: Default May 26 12:47:23.677440 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Id: 3cd0ea68fb8a43e886d0c9722d766ba6 May 26 12:47:23.677440 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Name: tempest-DeleteServersTestJSON-203793334 May 26 12:47:23.677440 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Role: member,reader May 26 12:47:23.677440 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Roles: member,reader May 26 12:47:23.678700 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/3cd0ea68fb8a43e886d0c9722d766ba6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/3cd0ea68fb8a43e886d0c9722d766ba6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/3cd0ea68fb8a43e886d0c9722d766ba6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_3cd0ea68fb8a43e886d0c9722d766ba6", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 26 12:47:23.678700 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Tenant: tempest-DeleteServersTestJSON-203793334 May 26 12:47:23.678700 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Tenant-Id: 3cd0ea68fb8a43e886d0c9722d766ba6 May 26 12:47:23.678700 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Tenant-Name: tempest-DeleteServersTestJSON-203793334 May 26 12:47:23.678700 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User: tempest-DeleteServersTestJSON-203793334-project May 26 12:47:23.678700 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Domain-Id: default May 26 12:47:23.678700 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Domain-Name: Default May 26 12:47:23.678700 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Id: 4d380efbe8c44fb3bbc58c9913cb25e6 May 26 12:47:23.678700 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Name: tempest-DeleteServersTestJSON-203793334-project May 26 12:47:23.678700 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: method: > May 26 12:47:23.678700 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: exception: Instance d3b264dc-45ea-4e2f-8e62-42f1b7424d50 could not be found. May 26 12:47:23.678700 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: action_args: {'id': 'd3b264dc-45ea-4e2f-8e62-42f1b7424d50'} May 26 12:47:23.683135 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:47:23.683135 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:47:23.683135 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:47:23.683135 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:47:23.683135 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:47:23.683135 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:47:23.683135 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:47:23.683135 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:47:23.683135 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:47:23.683135 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:47:23.683135 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3b264dc-45ea-4e2f-8e62-42f1b7424d50 could not be found. May 26 12:47:23.683135 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:47:23.683135 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:47:23.683135 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:47:23.683135 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:47:23.683135 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:47:23.683135 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:47:23.683135 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:47:23.683135 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:47:23.683135 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:47:23.684517 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:47:23.684517 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 12:47:23.684517 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 12:47:23.684517 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:47:23.684517 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:47:23.684517 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:47:23.684517 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:47:23.684517 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3b264dc-45ea-4e2f-8e62-42f1b7424d50 could not be found. May 26 12:47:23.684517 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:47:23.684517 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:47:23.684517 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:47:23.684517 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:47:23.684517 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:47:23.684517 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:47:23.684517 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:47:23.684517 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:47:23.684517 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3b264dc-45ea-4e2f-8e62-42f1b7424d50 could not be found. May 26 12:47:23.684517 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:47:23.685707 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-6910bcf4-92b6-4d61-b0be-8685c73a903e tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Returning 404 to user: Instance d3b264dc-45ea-4e2f-8e62-42f1b7424d50 could not be found. {{(pid=124824) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:47:23.685707 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-6910bcf4-92b6-4d61-b0be-8685c73a903e tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] 10.222.0.41 "GET /compute/v2.1/servers/d3b264dc-45ea-4e2f-8e62-42f1b7424d50" status: 404 len: 111 microversion: 2.1 time: 0.039096 May 26 12:47:23.685707 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 91/192] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:47:23 2022] GET /compute/v2.1/servers/d3b264dc-45ea-4e2f-8e62-42f1b7424d50 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:47:23.796622 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-8b1075fa-1674-453a-bd6f-704388d74354 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:23.797805 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-8b1075fa-1674-453a-bd6f-704388d74354 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] [instance: d3b264dc-45ea-4e2f-8e62-42f1b7424d50] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:23.804494 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-8b1075fa-1674-453a-bd6f-704388d74354 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:23.804922 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-8b1075fa-1674-453a-bd6f-704388d74354 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:23.805728 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-8b1075fa-1674-453a-bd6f-704388d74354 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:23.806161 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-8b1075fa-1674-453a-bd6f-704388d74354 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:23.822576 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.wsgi [None req-8b1075fa-1674-453a-bd6f-704388d74354 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] HTTP exception thrown: Instance d3b264dc-45ea-4e2f-8e62-42f1b7424d50 could not be found. May 26 12:47:23.827033 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-8b1075fa-1674-453a-bd6f-704388d74354 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Request method failure captured: May 26 12:47:23.827033 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: request: GET /compute/v2.1/servers/d3b264dc-45ea-4e2f-8e62-42f1b7424d50/os-volume_attachments HTTP/1.1 May 26 12:47:23.827033 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Accept: application/json May 26 12:47:23.827033 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Accept-Encoding: identity May 26 12:47:23.827033 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Connection: close May 26 12:47:23.827033 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Content-Length: 0 May 26 12:47:23.827033 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Content-Type: application/json May 26 12:47:23.827033 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Host: 10.222.0.41 May 26 12:47:23.827033 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Openstack-System-Scope: None May 26 12:47:23.827033 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: User-Agent: python-urllib3/1.26.9 May 26 12:47:23.827033 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Auth-Token: gAAAAABij3aNXXsqN7z5ri-l8wO3Af084AG64gNcAfjP9VcWLp4rH-I2hKVHsG-nSqO0G3TyC_p839gAM6SmGG09Z1aENcPAAUtOWoR_QnBrByUu7_iqyZwsYLOrL7o6hXk2yx1U9Rh7kfHOdEuq6Qak0dzSKxAr5zGPZlupmC-6m4T0d5eJVhQ May 26 12:47:23.827033 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Domain-Id: None May 26 12:47:23.827033 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Domain-Name: None May 26 12:47:23.827033 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Identity-Status: Confirmed May 26 12:47:23.827033 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Is-Admin-Project: True May 26 12:47:23.827033 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Project-Domain-Id: default May 26 12:47:23.827033 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Project-Domain-Name: Default May 26 12:47:23.827033 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Project-Id: 3cd0ea68fb8a43e886d0c9722d766ba6 May 26 12:47:23.827033 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Project-Name: tempest-DeleteServersTestJSON-203793334 May 26 12:47:23.827033 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Role: member,reader May 26 12:47:23.827033 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Roles: member,reader May 26 12:47:23.829134 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/3cd0ea68fb8a43e886d0c9722d766ba6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/3cd0ea68fb8a43e886d0c9722d766ba6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/3cd0ea68fb8a43e886d0c9722d766ba6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_3cd0ea68fb8a43e886d0c9722d766ba6", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 26 12:47:23.829134 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Tenant: tempest-DeleteServersTestJSON-203793334 May 26 12:47:23.829134 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Tenant-Id: 3cd0ea68fb8a43e886d0c9722d766ba6 May 26 12:47:23.829134 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Tenant-Name: tempest-DeleteServersTestJSON-203793334 May 26 12:47:23.829134 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User: tempest-DeleteServersTestJSON-203793334-project May 26 12:47:23.829134 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User-Domain-Id: default May 26 12:47:23.829134 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User-Domain-Name: Default May 26 12:47:23.829134 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User-Id: 4d380efbe8c44fb3bbc58c9913cb25e6 May 26 12:47:23.829134 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User-Name: tempest-DeleteServersTestJSON-203793334-project May 26 12:47:23.829134 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: method: > May 26 12:47:23.829134 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: exception: Instance d3b264dc-45ea-4e2f-8e62-42f1b7424d50 could not be found. May 26 12:47:23.829134 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: action_args: {'server_id': 'd3b264dc-45ea-4e2f-8e62-42f1b7424d50'} May 26 12:47:23.830357 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:47:23.830357 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:47:23.830357 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:47:23.830357 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:47:23.830357 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:47:23.830357 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:47:23.830357 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:47:23.830357 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:47:23.830357 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:47:23.830357 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:47:23.830357 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3b264dc-45ea-4e2f-8e62-42f1b7424d50 could not be found. May 26 12:47:23.830357 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:47:23.830357 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:47:23.830357 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:47:23.830357 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:47:23.830357 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:47:23.830357 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:47:23.830357 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:47:23.830357 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:47:23.830357 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:47:23.833336 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:47:23.833336 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 26 12:47:23.833336 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 12:47:23.833336 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 26 12:47:23.833336 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 12:47:23.833336 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 26 12:47:23.833336 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 26 12:47:23.833336 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:47:23.833336 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:47:23.833336 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3b264dc-45ea-4e2f-8e62-42f1b7424d50 could not be found. May 26 12:47:23.833336 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:47:23.833336 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:47:23.833336 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:47:23.833336 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:47:23.833336 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:47:23.833336 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:47:23.833336 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:47:23.833336 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:47:23.833336 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3b264dc-45ea-4e2f-8e62-42f1b7424d50 could not be found. May 26 12:47:23.833336 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:47:23.836905 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-8b1075fa-1674-453a-bd6f-704388d74354 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Returning 404 to user: Instance d3b264dc-45ea-4e2f-8e62-42f1b7424d50 could not be found. {{(pid=124823) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:47:23.836905 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-8b1075fa-1674-453a-bd6f-704388d74354 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] 10.222.0.41 "GET /compute/v2.1/servers/d3b264dc-45ea-4e2f-8e62-42f1b7424d50/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.035887 May 26 12:47:23.836905 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 102/193] 10.222.0.41 () {58 vars in 1301 bytes} [Thu May 26 12:47:23 2022] GET /compute/v2.1/servers/d3b264dc-45ea-4e2f-8e62-42f1b7424d50/os-volume_attachments => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:47:24.312854 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-9c69c6b5-14c8-4fca-8436-be3d308c1407 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:24.314747 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-9c69c6b5-14c8-4fca-8436-be3d308c1407 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: a442ae3a-5311-4f8f-acf3-08ce1534c9ea] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:24.323460 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-9c69c6b5-14c8-4fca-8436-be3d308c1407 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:24.323991 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-9c69c6b5-14c8-4fca-8436-be3d308c1407 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:24.324774 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-9c69c6b5-14c8-4fca-8436-be3d308c1407 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:24.325212 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-9c69c6b5-14c8-4fca-8436-be3d308c1407 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:24.508899 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-9c69c6b5-14c8-4fca-8436-be3d308c1407 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:24.518768 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-9c69c6b5-14c8-4fca-8436-be3d308c1407 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea" status: 200 len: 1520 microversion: 2.1 time: 0.210209 May 26 12:47:24.519420 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 92/194] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:47:24 2022] GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea => generated 1520 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:25.237596 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-28fa92a3-f989-4fbb-b31d-3fa1ddb16129 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:25.238131 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-28fa92a3-f989-4fbb-b31d-3fa1ddb16129 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] [instance: d3b264dc-45ea-4e2f-8e62-42f1b7424d50] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:25.246318 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-28fa92a3-f989-4fbb-b31d-3fa1ddb16129 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:25.246772 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-28fa92a3-f989-4fbb-b31d-3fa1ddb16129 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:25.247647 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-28fa92a3-f989-4fbb-b31d-3fa1ddb16129 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:25.247976 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-28fa92a3-f989-4fbb-b31d-3fa1ddb16129 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:25.262377 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.wsgi [None req-28fa92a3-f989-4fbb-b31d-3fa1ddb16129 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] HTTP exception thrown: Instance d3b264dc-45ea-4e2f-8e62-42f1b7424d50 could not be found. May 26 12:47:25.264562 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-28fa92a3-f989-4fbb-b31d-3fa1ddb16129 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Request method failure captured: May 26 12:47:25.264562 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: request: DELETE /compute/v2.1/servers/d3b264dc-45ea-4e2f-8e62-42f1b7424d50 HTTP/1.1 May 26 12:47:25.264562 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Accept: application/json May 26 12:47:25.264562 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Accept-Encoding: identity May 26 12:47:25.264562 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Connection: close May 26 12:47:25.264562 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Content-Length: 0 May 26 12:47:25.264562 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Content-Type: application/json May 26 12:47:25.264562 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Host: 10.222.0.41 May 26 12:47:25.264562 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Openstack-System-Scope: None May 26 12:47:25.264562 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: User-Agent: python-urllib3/1.26.9 May 26 12:47:25.264562 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Auth-Token: gAAAAABij3aNXXsqN7z5ri-l8wO3Af084AG64gNcAfjP9VcWLp4rH-I2hKVHsG-nSqO0G3TyC_p839gAM6SmGG09Z1aENcPAAUtOWoR_QnBrByUu7_iqyZwsYLOrL7o6hXk2yx1U9Rh7kfHOdEuq6Qak0dzSKxAr5zGPZlupmC-6m4T0d5eJVhQ May 26 12:47:25.264562 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Domain-Id: None May 26 12:47:25.264562 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Domain-Name: None May 26 12:47:25.264562 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Identity-Status: Confirmed May 26 12:47:25.264562 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Is-Admin-Project: True May 26 12:47:25.264562 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Project-Domain-Id: default May 26 12:47:25.264562 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Project-Domain-Name: Default May 26 12:47:25.264562 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Project-Id: 3cd0ea68fb8a43e886d0c9722d766ba6 May 26 12:47:25.264562 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Project-Name: tempest-DeleteServersTestJSON-203793334 May 26 12:47:25.264562 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Role: member,reader May 26 12:47:25.264562 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Roles: member,reader May 26 12:47:25.265838 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/3cd0ea68fb8a43e886d0c9722d766ba6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/3cd0ea68fb8a43e886d0c9722d766ba6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/3cd0ea68fb8a43e886d0c9722d766ba6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_3cd0ea68fb8a43e886d0c9722d766ba6", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 26 12:47:25.265838 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Tenant: tempest-DeleteServersTestJSON-203793334 May 26 12:47:25.265838 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Tenant-Id: 3cd0ea68fb8a43e886d0c9722d766ba6 May 26 12:47:25.265838 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Tenant-Name: tempest-DeleteServersTestJSON-203793334 May 26 12:47:25.265838 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User: tempest-DeleteServersTestJSON-203793334-project May 26 12:47:25.265838 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User-Domain-Id: default May 26 12:47:25.265838 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User-Domain-Name: Default May 26 12:47:25.265838 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User-Id: 4d380efbe8c44fb3bbc58c9913cb25e6 May 26 12:47:25.265838 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User-Name: tempest-DeleteServersTestJSON-203793334-project May 26 12:47:25.265838 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: method: > May 26 12:47:25.265838 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: exception: Instance d3b264dc-45ea-4e2f-8e62-42f1b7424d50 could not be found. May 26 12:47:25.265838 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: action_args: {'id': 'd3b264dc-45ea-4e2f-8e62-42f1b7424d50'} May 26 12:47:25.266488 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:47:25.266488 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:47:25.266488 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:47:25.266488 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:47:25.266488 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:47:25.266488 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:47:25.266488 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:47:25.266488 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:47:25.266488 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:47:25.266488 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:47:25.266488 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3b264dc-45ea-4e2f-8e62-42f1b7424d50 could not be found. May 26 12:47:25.266488 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:47:25.266488 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:47:25.266488 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:47:25.266488 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:47:25.266488 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:47:25.266488 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:47:25.266488 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:47:25.266488 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:47:25.266488 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:47:25.267584 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:47:25.267584 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 12:47:25.267584 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 12:47:25.267584 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 12:47:25.267584 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 12:47:25.267584 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:47:25.267584 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:47:25.267584 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:47:25.267584 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:47:25.267584 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3b264dc-45ea-4e2f-8e62-42f1b7424d50 could not be found. May 26 12:47:25.267584 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:47:25.267584 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:47:25.267584 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:47:25.267584 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:47:25.267584 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:47:25.267584 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:47:25.267584 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:47:25.267584 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:47:25.267584 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3b264dc-45ea-4e2f-8e62-42f1b7424d50 could not be found. May 26 12:47:25.267584 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:47:25.268671 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-28fa92a3-f989-4fbb-b31d-3fa1ddb16129 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Returning 404 to user: Instance d3b264dc-45ea-4e2f-8e62-42f1b7424d50 could not be found. {{(pid=124823) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:47:25.268671 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-28fa92a3-f989-4fbb-b31d-3fa1ddb16129 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] 10.222.0.41 "DELETE /compute/v2.1/servers/d3b264dc-45ea-4e2f-8e62-42f1b7424d50" status: 404 len: 111 microversion: 2.1 time: 0.032284 May 26 12:47:25.268671 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 103/195] 10.222.0.41 () {58 vars in 1238 bytes} [Thu May 26 12:47:25 2022] DELETE /compute/v2.1/servers/d3b264dc-45ea-4e2f-8e62-42f1b7424d50 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:47:25.275816 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-01847d2f-228f-40d6-8fb2-e1fce7d1e446 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:25.276548 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-01847d2f-228f-40d6-8fb2-e1fce7d1e446 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] [instance: d3b264dc-45ea-4e2f-8e62-42f1b7424d50] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:25.283298 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-01847d2f-228f-40d6-8fb2-e1fce7d1e446 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:25.283743 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-01847d2f-228f-40d6-8fb2-e1fce7d1e446 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:25.284512 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-01847d2f-228f-40d6-8fb2-e1fce7d1e446 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:25.284938 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-01847d2f-228f-40d6-8fb2-e1fce7d1e446 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:25.299507 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.wsgi [None req-01847d2f-228f-40d6-8fb2-e1fce7d1e446 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] HTTP exception thrown: Instance d3b264dc-45ea-4e2f-8e62-42f1b7424d50 could not be found. May 26 12:47:25.301230 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-01847d2f-228f-40d6-8fb2-e1fce7d1e446 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Request method failure captured: May 26 12:47:25.301230 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: request: GET /compute/v2.1/servers/d3b264dc-45ea-4e2f-8e62-42f1b7424d50 HTTP/1.1 May 26 12:47:25.301230 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Accept: application/json May 26 12:47:25.301230 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Accept-Encoding: identity May 26 12:47:25.301230 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Connection: close May 26 12:47:25.301230 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Content-Length: 0 May 26 12:47:25.301230 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Content-Type: application/json May 26 12:47:25.301230 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Host: 10.222.0.41 May 26 12:47:25.301230 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Openstack-System-Scope: None May 26 12:47:25.301230 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: User-Agent: python-urllib3/1.26.9 May 26 12:47:25.301230 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Auth-Token: gAAAAABij3aNXXsqN7z5ri-l8wO3Af084AG64gNcAfjP9VcWLp4rH-I2hKVHsG-nSqO0G3TyC_p839gAM6SmGG09Z1aENcPAAUtOWoR_QnBrByUu7_iqyZwsYLOrL7o6hXk2yx1U9Rh7kfHOdEuq6Qak0dzSKxAr5zGPZlupmC-6m4T0d5eJVhQ May 26 12:47:25.301230 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Domain-Id: None May 26 12:47:25.301230 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Domain-Name: None May 26 12:47:25.301230 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Identity-Status: Confirmed May 26 12:47:25.301230 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Is-Admin-Project: True May 26 12:47:25.301230 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Domain-Id: default May 26 12:47:25.301230 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Domain-Name: Default May 26 12:47:25.301230 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Id: 3cd0ea68fb8a43e886d0c9722d766ba6 May 26 12:47:25.301230 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Name: tempest-DeleteServersTestJSON-203793334 May 26 12:47:25.301230 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Role: member,reader May 26 12:47:25.301230 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Roles: member,reader May 26 12:47:25.304475 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/3cd0ea68fb8a43e886d0c9722d766ba6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/3cd0ea68fb8a43e886d0c9722d766ba6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/3cd0ea68fb8a43e886d0c9722d766ba6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_3cd0ea68fb8a43e886d0c9722d766ba6", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 26 12:47:25.304475 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Tenant: tempest-DeleteServersTestJSON-203793334 May 26 12:47:25.304475 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Tenant-Id: 3cd0ea68fb8a43e886d0c9722d766ba6 May 26 12:47:25.304475 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Tenant-Name: tempest-DeleteServersTestJSON-203793334 May 26 12:47:25.304475 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User: tempest-DeleteServersTestJSON-203793334-project May 26 12:47:25.304475 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Domain-Id: default May 26 12:47:25.304475 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Domain-Name: Default May 26 12:47:25.304475 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Id: 4d380efbe8c44fb3bbc58c9913cb25e6 May 26 12:47:25.304475 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Name: tempest-DeleteServersTestJSON-203793334-project May 26 12:47:25.304475 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: method: > May 26 12:47:25.304475 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: exception: Instance d3b264dc-45ea-4e2f-8e62-42f1b7424d50 could not be found. May 26 12:47:25.304475 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: action_args: {'id': 'd3b264dc-45ea-4e2f-8e62-42f1b7424d50'} May 26 12:47:25.305250 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:47:25.305250 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:47:25.305250 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:47:25.305250 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:47:25.305250 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:47:25.305250 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:47:25.305250 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:47:25.305250 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:47:25.305250 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:47:25.305250 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:47:25.305250 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3b264dc-45ea-4e2f-8e62-42f1b7424d50 could not be found. May 26 12:47:25.305250 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:47:25.305250 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:47:25.305250 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:47:25.305250 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:47:25.305250 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:47:25.305250 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:47:25.305250 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:47:25.305250 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:47:25.305250 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:47:25.306373 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:47:25.306373 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 12:47:25.306373 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 12:47:25.306373 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:47:25.306373 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:47:25.306373 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:47:25.306373 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:47:25.306373 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3b264dc-45ea-4e2f-8e62-42f1b7424d50 could not be found. May 26 12:47:25.306373 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:47:25.306373 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:47:25.306373 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:47:25.306373 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:47:25.306373 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:47:25.306373 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:47:25.306373 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:47:25.306373 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:47:25.306373 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3b264dc-45ea-4e2f-8e62-42f1b7424d50 could not be found. May 26 12:47:25.306373 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:47:25.307489 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-01847d2f-228f-40d6-8fb2-e1fce7d1e446 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] Returning 404 to user: Instance d3b264dc-45ea-4e2f-8e62-42f1b7424d50 could not be found. {{(pid=124824) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:47:25.307489 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-01847d2f-228f-40d6-8fb2-e1fce7d1e446 tempest-DeleteServersTestJSON-203793334 tempest-DeleteServersTestJSON-203793334-project] 10.222.0.41 "GET /compute/v2.1/servers/d3b264dc-45ea-4e2f-8e62-42f1b7424d50" status: 404 len: 111 microversion: 2.1 time: 0.031531 May 26 12:47:25.307489 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 93/196] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:47:25 2022] GET /compute/v2.1/servers/d3b264dc-45ea-4e2f-8e62-42f1b7424d50 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:47:25.536312 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-fd65bda0-5aa0-47fa-b59a-30ab5bd324ec tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:25.536925 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-fd65bda0-5aa0-47fa-b59a-30ab5bd324ec tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: a442ae3a-5311-4f8f-acf3-08ce1534c9ea] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:25.545197 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-fd65bda0-5aa0-47fa-b59a-30ab5bd324ec tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:25.546161 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-fd65bda0-5aa0-47fa-b59a-30ab5bd324ec tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:25.547546 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-fd65bda0-5aa0-47fa-b59a-30ab5bd324ec tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:25.548563 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-fd65bda0-5aa0-47fa-b59a-30ab5bd324ec tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:25.788324 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-fd65bda0-5aa0-47fa-b59a-30ab5bd324ec tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:25.796865 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-fd65bda0-5aa0-47fa-b59a-30ab5bd324ec tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea" status: 200 len: 1520 microversion: 2.1 time: 0.264721 May 26 12:47:25.797453 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 104/197] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:47:25 2022] GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea => generated 1520 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:26.815406 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-42930411-2096-4c9b-bf64-3a772ef69f77 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:26.816009 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-42930411-2096-4c9b-bf64-3a772ef69f77 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: a442ae3a-5311-4f8f-acf3-08ce1534c9ea] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:26.822891 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-42930411-2096-4c9b-bf64-3a772ef69f77 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:26.823343 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-42930411-2096-4c9b-bf64-3a772ef69f77 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:26.824100 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-42930411-2096-4c9b-bf64-3a772ef69f77 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:26.824564 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-42930411-2096-4c9b-bf64-3a772ef69f77 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:26.975511 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-42930411-2096-4c9b-bf64-3a772ef69f77 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:26.983888 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-42930411-2096-4c9b-bf64-3a772ef69f77 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea" status: 200 len: 1520 microversion: 2.1 time: 0.172346 May 26 12:47:26.984547 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 94/198] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:47:26 2022] GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:28.000598 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-9460146a-5768-44d5-a298-442d9a2df4bd tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:28.001190 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-9460146a-5768-44d5-a298-442d9a2df4bd tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: a442ae3a-5311-4f8f-acf3-08ce1534c9ea] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:28.007847 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-9460146a-5768-44d5-a298-442d9a2df4bd tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:28.008292 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-9460146a-5768-44d5-a298-442d9a2df4bd tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:28.009056 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-9460146a-5768-44d5-a298-442d9a2df4bd tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:28.009491 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-9460146a-5768-44d5-a298-442d9a2df4bd tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:28.169116 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-9460146a-5768-44d5-a298-442d9a2df4bd tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:28.183294 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-9460146a-5768-44d5-a298-442d9a2df4bd tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea" status: 200 len: 1520 microversion: 2.1 time: 0.186448 May 26 12:47:28.183892 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 105/199] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:47:27 2022] GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea => generated 1520 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:29.201552 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-e11991db-c328-4e46-b2b8-82bae77fc2cc tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:29.202395 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-e11991db-c328-4e46-b2b8-82bae77fc2cc tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: a442ae3a-5311-4f8f-acf3-08ce1534c9ea] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:29.213648 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-e11991db-c328-4e46-b2b8-82bae77fc2cc tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:29.214283 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-e11991db-c328-4e46-b2b8-82bae77fc2cc tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:29.215540 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-e11991db-c328-4e46-b2b8-82bae77fc2cc tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:29.216913 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-e11991db-c328-4e46-b2b8-82bae77fc2cc tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:29.403859 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-e11991db-c328-4e46-b2b8-82bae77fc2cc tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:29.412658 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-e11991db-c328-4e46-b2b8-82bae77fc2cc tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea" status: 200 len: 1520 microversion: 2.1 time: 0.215673 May 26 12:47:29.413242 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 95/200] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:47:29 2022] GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea => generated 1520 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:30.432744 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-5941fa6a-30c5-4dd5-8a10-d031cb0981a7 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:30.435418 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-5941fa6a-30c5-4dd5-8a10-d031cb0981a7 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: a442ae3a-5311-4f8f-acf3-08ce1534c9ea] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:30.446078 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-5941fa6a-30c5-4dd5-8a10-d031cb0981a7 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:30.446736 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-5941fa6a-30c5-4dd5-8a10-d031cb0981a7 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:30.447773 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-5941fa6a-30c5-4dd5-8a10-d031cb0981a7 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:30.448303 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-5941fa6a-30c5-4dd5-8a10-d031cb0981a7 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:30.636382 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-5941fa6a-30c5-4dd5-8a10-d031cb0981a7 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:30.636382 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-5941fa6a-30c5-4dd5-8a10-d031cb0981a7 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea" status: 200 len: 1520 microversion: 2.1 time: 0.181790 May 26 12:47:30.636382 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 106/201] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:47:30 2022] GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea => generated 1520 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:31.647059 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-f92ca68f-1908-4133-bfb5-9891238316b9 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:31.648292 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-f92ca68f-1908-4133-bfb5-9891238316b9 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: a442ae3a-5311-4f8f-acf3-08ce1534c9ea] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:31.650477 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG dbcounter [-] [124824] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=124824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:31.655442 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-f92ca68f-1908-4133-bfb5-9891238316b9 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:31.655894 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-f92ca68f-1908-4133-bfb5-9891238316b9 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:31.656657 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-f92ca68f-1908-4133-bfb5-9891238316b9 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:31.657090 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-f92ca68f-1908-4133-bfb5-9891238316b9 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:31.811971 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-f92ca68f-1908-4133-bfb5-9891238316b9 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:31.811971 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-f92ca68f-1908-4133-bfb5-9891238316b9 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea" status: 200 len: 1520 microversion: 2.1 time: 0.160560 May 26 12:47:31.811971 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 96/202] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:47:31 2022] GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:32.829442 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-9bd25fd1-ba70-49db-837b-da2dca1a8745 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:32.830127 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-9bd25fd1-ba70-49db-837b-da2dca1a8745 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: a442ae3a-5311-4f8f-acf3-08ce1534c9ea] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:32.836900 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-9bd25fd1-ba70-49db-837b-da2dca1a8745 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:32.837286 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-9bd25fd1-ba70-49db-837b-da2dca1a8745 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:32.838071 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-9bd25fd1-ba70-49db-837b-da2dca1a8745 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:32.838505 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-9bd25fd1-ba70-49db-837b-da2dca1a8745 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:33.011791 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-9bd25fd1-ba70-49db-837b-da2dca1a8745 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:33.021333 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-9bd25fd1-ba70-49db-837b-da2dca1a8745 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea" status: 200 len: 1520 microversion: 2.1 time: 0.195657 May 26 12:47:33.022018 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 107/203] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:47:32 2022] GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea => generated 1520 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:34.040622 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-8a1455ca-efaf-47dc-b61f-68ae878b86cb tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:34.041241 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-8a1455ca-efaf-47dc-b61f-68ae878b86cb tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: a442ae3a-5311-4f8f-acf3-08ce1534c9ea] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:34.048544 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-8a1455ca-efaf-47dc-b61f-68ae878b86cb tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:34.049001 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-8a1455ca-efaf-47dc-b61f-68ae878b86cb tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:34.049994 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-8a1455ca-efaf-47dc-b61f-68ae878b86cb tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:34.050433 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-8a1455ca-efaf-47dc-b61f-68ae878b86cb tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:34.216942 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-8a1455ca-efaf-47dc-b61f-68ae878b86cb tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:34.225318 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-8a1455ca-efaf-47dc-b61f-68ae878b86cb tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea" status: 200 len: 1520 microversion: 2.1 time: 0.190058 May 26 12:47:34.225939 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 97/204] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:47:34 2022] GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea => generated 1520 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:35.248205 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-0d9e9ee7-2b83-4d68-8cc2-17421817a02e tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:35.248882 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-0d9e9ee7-2b83-4d68-8cc2-17421817a02e tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: a442ae3a-5311-4f8f-acf3-08ce1534c9ea] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:35.255679 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-0d9e9ee7-2b83-4d68-8cc2-17421817a02e tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:35.256134 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-0d9e9ee7-2b83-4d68-8cc2-17421817a02e tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:35.256897 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-0d9e9ee7-2b83-4d68-8cc2-17421817a02e tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:35.257955 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-0d9e9ee7-2b83-4d68-8cc2-17421817a02e tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:35.425965 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-0d9e9ee7-2b83-4d68-8cc2-17421817a02e tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:35.436741 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-0d9e9ee7-2b83-4d68-8cc2-17421817a02e tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea" status: 200 len: 1520 microversion: 2.1 time: 0.193567 May 26 12:47:35.437995 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 108/205] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:47:35 2022] GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea => generated 1520 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:36.455085 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-e51838db-d67e-4dcf-8bf0-77a49fb837f9 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:36.461776 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-e51838db-d67e-4dcf-8bf0-77a49fb837f9 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: a442ae3a-5311-4f8f-acf3-08ce1534c9ea] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:36.474480 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-e51838db-d67e-4dcf-8bf0-77a49fb837f9 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:36.474693 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-e51838db-d67e-4dcf-8bf0-77a49fb837f9 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:36.479730 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-e51838db-d67e-4dcf-8bf0-77a49fb837f9 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:36.479730 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-e51838db-d67e-4dcf-8bf0-77a49fb837f9 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:36.620915 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-e51838db-d67e-4dcf-8bf0-77a49fb837f9 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:36.635587 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-e51838db-d67e-4dcf-8bf0-77a49fb837f9 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea" status: 200 len: 1520 microversion: 2.1 time: 0.184433 May 26 12:47:36.636663 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 98/206] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:47:36 2022] GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea => generated 1520 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:37.652679 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-533aecb0-b1fd-4caa-8a7c-93cc2a09b0e0 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:37.653299 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-533aecb0-b1fd-4caa-8a7c-93cc2a09b0e0 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: a442ae3a-5311-4f8f-acf3-08ce1534c9ea] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:37.660039 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-533aecb0-b1fd-4caa-8a7c-93cc2a09b0e0 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:37.660487 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-533aecb0-b1fd-4caa-8a7c-93cc2a09b0e0 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:37.661271 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-533aecb0-b1fd-4caa-8a7c-93cc2a09b0e0 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:37.661734 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-533aecb0-b1fd-4caa-8a7c-93cc2a09b0e0 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:37.798178 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-533aecb0-b1fd-4caa-8a7c-93cc2a09b0e0 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:37.806571 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-533aecb0-b1fd-4caa-8a7c-93cc2a09b0e0 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea" status: 200 len: 1520 microversion: 2.1 time: 0.157705 May 26 12:47:37.807139 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 109/207] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:47:37 2022] GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:38.832240 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-b994e968-6656-44de-a7d6-41ded1210641 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:38.832240 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-b994e968-6656-44de-a7d6-41ded1210641 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: a442ae3a-5311-4f8f-acf3-08ce1534c9ea] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:38.836245 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-b994e968-6656-44de-a7d6-41ded1210641 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:38.836698 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-b994e968-6656-44de-a7d6-41ded1210641 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:38.837475 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-b994e968-6656-44de-a7d6-41ded1210641 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:38.838131 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-b994e968-6656-44de-a7d6-41ded1210641 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:38.997143 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-b994e968-6656-44de-a7d6-41ded1210641 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:38.999945 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG dbcounter [-] [124824] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:39.006182 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-b994e968-6656-44de-a7d6-41ded1210641 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea" status: 200 len: 1520 microversion: 2.1 time: 0.184759 May 26 12:47:39.006780 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 99/208] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:47:38 2022] GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea => generated 1520 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:40.026207 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-caf193ad-2815-4c6a-afc8-e93bc67b8fd5 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:40.026828 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-caf193ad-2815-4c6a-afc8-e93bc67b8fd5 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: a442ae3a-5311-4f8f-acf3-08ce1534c9ea] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:40.034463 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-caf193ad-2815-4c6a-afc8-e93bc67b8fd5 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:40.035212 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-caf193ad-2815-4c6a-afc8-e93bc67b8fd5 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:40.036018 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-caf193ad-2815-4c6a-afc8-e93bc67b8fd5 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:40.036490 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-caf193ad-2815-4c6a-afc8-e93bc67b8fd5 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:40.177717 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-caf193ad-2815-4c6a-afc8-e93bc67b8fd5 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:40.186001 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-caf193ad-2815-4c6a-afc8-e93bc67b8fd5 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea" status: 200 len: 1520 microversion: 2.1 time: 0.165163 May 26 12:47:40.186697 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 110/209] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:47:40 2022] GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:47:41.203540 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-c0efddd8-2945-48e4-bedd-bb0ff95194c4 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:41.204240 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-c0efddd8-2945-48e4-bedd-bb0ff95194c4 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: a442ae3a-5311-4f8f-acf3-08ce1534c9ea] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:41.211843 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-c0efddd8-2945-48e4-bedd-bb0ff95194c4 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:41.212291 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-c0efddd8-2945-48e4-bedd-bb0ff95194c4 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:41.213100 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-c0efddd8-2945-48e4-bedd-bb0ff95194c4 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:41.229760 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-c0efddd8-2945-48e4-bedd-bb0ff95194c4 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:41.371520 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-c0efddd8-2945-48e4-bedd-bb0ff95194c4 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:41.378917 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-c0efddd8-2945-48e4-bedd-bb0ff95194c4 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea" status: 200 len: 1520 microversion: 2.1 time: 0.179631 May 26 12:47:41.379476 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 100/210] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:47:41 2022] GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea => generated 1520 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:42.396793 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-8251d814-586a-449e-a263-4579607ba556 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:42.397428 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-8251d814-586a-449e-a263-4579607ba556 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: a442ae3a-5311-4f8f-acf3-08ce1534c9ea] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:42.400056 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG dbcounter [-] [124823] Writing DB stats nova_api:SELECT=38 {{(pid=124823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:42.405234 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-8251d814-586a-449e-a263-4579607ba556 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:42.405774 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-8251d814-586a-449e-a263-4579607ba556 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:42.406641 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-8251d814-586a-449e-a263-4579607ba556 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:42.407109 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-8251d814-586a-449e-a263-4579607ba556 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:42.576476 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-8251d814-586a-449e-a263-4579607ba556 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:42.593327 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-8251d814-586a-449e-a263-4579607ba556 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea" status: 200 len: 1520 microversion: 2.1 time: 0.200728 May 26 12:47:42.603522 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 111/211] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:47:42 2022] GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea => generated 1520 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:43.611391 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-bacf32eb-51d7-4a67-a1db-a90d2204de40 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:43.612742 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-bacf32eb-51d7-4a67-a1db-a90d2204de40 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: a442ae3a-5311-4f8f-acf3-08ce1534c9ea] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:43.620003 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-bacf32eb-51d7-4a67-a1db-a90d2204de40 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:43.620601 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-bacf32eb-51d7-4a67-a1db-a90d2204de40 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:43.622048 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-bacf32eb-51d7-4a67-a1db-a90d2204de40 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:43.622556 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-bacf32eb-51d7-4a67-a1db-a90d2204de40 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:43.784087 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-bacf32eb-51d7-4a67-a1db-a90d2204de40 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:43.792450 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-bacf32eb-51d7-4a67-a1db-a90d2204de40 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea" status: 200 len: 1520 microversion: 2.1 time: 0.185290 May 26 12:47:43.793037 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 101/212] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:47:43 2022] GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea => generated 1520 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:44.810959 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-46fccbc2-c9ca-4181-9613-948232c36c49 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:44.812332 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-46fccbc2-c9ca-4181-9613-948232c36c49 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: a442ae3a-5311-4f8f-acf3-08ce1534c9ea] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:44.825282 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-46fccbc2-c9ca-4181-9613-948232c36c49 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:44.825765 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-46fccbc2-c9ca-4181-9613-948232c36c49 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:44.826561 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-46fccbc2-c9ca-4181-9613-948232c36c49 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:44.827305 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-46fccbc2-c9ca-4181-9613-948232c36c49 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:45.041240 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-46fccbc2-c9ca-4181-9613-948232c36c49 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:45.070222 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-46fccbc2-c9ca-4181-9613-948232c36c49 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea" status: 200 len: 1500 microversion: 2.1 time: 0.263020 May 26 12:47:45.086264 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 112/213] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:47:44 2022] GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea => generated 1500 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:45.100532 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-5ee96e06-dd06-4718-ae60-2dec03584fff tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:45.102324 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-5ee96e06-dd06-4718-ae60-2dec03584fff tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:45.109930 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-5ee96e06-dd06-4718-ae60-2dec03584fff tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:45.110382 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-5ee96e06-dd06-4718-ae60-2dec03584fff tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:45.112073 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-5ee96e06-dd06-4718-ae60-2dec03584fff tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:45.112519 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-5ee96e06-dd06-4718-ae60-2dec03584fff tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:45.247349 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-5ee96e06-dd06-4718-ae60-2dec03584fff tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:45.255883 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-5ee96e06-dd06-4718-ae60-2dec03584fff tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a" status: 200 len: 1514 microversion: 2.1 time: 0.160732 May 26 12:47:45.256473 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 102/214] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:47:45 2022] GET /compute/v2.1/servers/c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a => generated 1514 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:47.341786 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-3c111d44-b890-4bb3-9e8c-0cf3536ebc9e tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:47:47.343532 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-3c111d44-b890-4bb3-9e8c-0cf3536ebc9e tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:47.351502 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-3c111d44-b890-4bb3-9e8c-0cf3536ebc9e tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:47.352225 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-3c111d44-b890-4bb3-9e8c-0cf3536ebc9e tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:47.353411 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-3c111d44-b890-4bb3-9e8c-0cf3536ebc9e tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:47.354073 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-3c111d44-b890-4bb3-9e8c-0cf3536ebc9e tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:47.380738 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.objects.instance [None req-3c111d44-b890-4bb3-9e8c-0cf3536ebc9e tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lazy-loading 'flavor' on Instance uuid c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a {{(pid=124823) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:47:47.830574 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-3c111d44-b890-4bb3-9e8c-0cf3536ebc9e tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "POST /compute/v2.1/servers/c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a/action" status: 200 len: 32 microversion: 2.1 time: 0.496782 May 26 12:47:47.831294 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 113/215] 10.222.0.41 () {60 vars in 1277 bytes} [Thu May 26 12:47:47 2022] POST /compute/v2.1/servers/c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a/action => generated 32 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 12:47:47.840349 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-53656fa9-fe1a-4942-9674-db3e5f9fd897 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:47.841105 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-53656fa9-fe1a-4942-9674-db3e5f9fd897 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:47.847600 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-53656fa9-fe1a-4942-9674-db3e5f9fd897 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:47.848051 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-53656fa9-fe1a-4942-9674-db3e5f9fd897 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:47.848814 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-53656fa9-fe1a-4942-9674-db3e5f9fd897 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:47.849245 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-53656fa9-fe1a-4942-9674-db3e5f9fd897 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:47.995250 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-53656fa9-fe1a-4942-9674-db3e5f9fd897 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:48.004419 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-53656fa9-fe1a-4942-9674-db3e5f9fd897 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a" status: 200 len: 1520 microversion: 2.1 time: 0.166941 May 26 12:47:48.009191 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 103/216] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:47:47 2022] GET /compute/v2.1/servers/c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:49.026883 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-be026360-a6f3-4f55-a43d-e4d989b933ca tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:49.027630 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-be026360-a6f3-4f55-a43d-e4d989b933ca tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:49.063834 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-be026360-a6f3-4f55-a43d-e4d989b933ca tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:49.064274 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-be026360-a6f3-4f55-a43d-e4d989b933ca tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:49.065073 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-be026360-a6f3-4f55-a43d-e4d989b933ca tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:49.065517 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-be026360-a6f3-4f55-a43d-e4d989b933ca tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:49.094187 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG dbcounter [-] [124823] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:49.263101 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-be026360-a6f3-4f55-a43d-e4d989b933ca tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:49.271444 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-be026360-a6f3-4f55-a43d-e4d989b933ca tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a" status: 200 len: 1520 microversion: 2.1 time: 0.248873 May 26 12:47:49.272038 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 114/217] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:47:49 2022] GET /compute/v2.1/servers/c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a => generated 1520 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:47:50.294190 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-6b163a32-0440-4188-be1b-6f3b79b522c7 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:50.294799 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-6b163a32-0440-4188-be1b-6f3b79b522c7 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:50.301224 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-6b163a32-0440-4188-be1b-6f3b79b522c7 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:50.301604 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-6b163a32-0440-4188-be1b-6f3b79b522c7 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:50.302396 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-6b163a32-0440-4188-be1b-6f3b79b522c7 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:50.302832 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-6b163a32-0440-4188-be1b-6f3b79b522c7 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:50.438574 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-6b163a32-0440-4188-be1b-6f3b79b522c7 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:50.446784 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-6b163a32-0440-4188-be1b-6f3b79b522c7 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a" status: 200 len: 1520 microversion: 2.1 time: 0.156444 May 26 12:47:50.447364 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 104/218] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:47:50 2022] GET /compute/v2.1/servers/c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:51.464425 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-5e2cc78f-06b1-4d7e-96a0-57cc1d8f1614 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:51.464989 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-5e2cc78f-06b1-4d7e-96a0-57cc1d8f1614 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:51.472030 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-5e2cc78f-06b1-4d7e-96a0-57cc1d8f1614 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:51.472477 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-5e2cc78f-06b1-4d7e-96a0-57cc1d8f1614 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:51.473248 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-5e2cc78f-06b1-4d7e-96a0-57cc1d8f1614 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:51.473705 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-5e2cc78f-06b1-4d7e-96a0-57cc1d8f1614 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:51.612128 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-5e2cc78f-06b1-4d7e-96a0-57cc1d8f1614 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:51.620455 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-5e2cc78f-06b1-4d7e-96a0-57cc1d8f1614 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a" status: 200 len: 1520 microversion: 2.1 time: 0.160361 May 26 12:47:51.621039 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 115/219] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:47:51 2022] GET /compute/v2.1/servers/c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:52.639738 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-1b6652da-4e5b-45af-ae60-a4147d200a0d tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:52.640422 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-1b6652da-4e5b-45af-ae60-a4147d200a0d tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:52.646850 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-1b6652da-4e5b-45af-ae60-a4147d200a0d tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:52.647295 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-1b6652da-4e5b-45af-ae60-a4147d200a0d tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:52.648214 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-1b6652da-4e5b-45af-ae60-a4147d200a0d tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:52.648647 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-1b6652da-4e5b-45af-ae60-a4147d200a0d tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:52.813684 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-1b6652da-4e5b-45af-ae60-a4147d200a0d tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:52.822262 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-1b6652da-4e5b-45af-ae60-a4147d200a0d tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a" status: 200 len: 1520 microversion: 2.1 time: 0.187831 May 26 12:47:52.822849 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 105/220] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:47:52 2022] GET /compute/v2.1/servers/c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a => generated 1520 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:53.841000 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-011da9da-cd74-4e89-b2d9-bd7efe911d43 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:53.841820 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-011da9da-cd74-4e89-b2d9-bd7efe911d43 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:53.848865 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-011da9da-cd74-4e89-b2d9-bd7efe911d43 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:53.849308 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-011da9da-cd74-4e89-b2d9-bd7efe911d43 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:53.850442 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-011da9da-cd74-4e89-b2d9-bd7efe911d43 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:53.850871 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-011da9da-cd74-4e89-b2d9-bd7efe911d43 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:53.990706 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-011da9da-cd74-4e89-b2d9-bd7efe911d43 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:53.999783 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-011da9da-cd74-4e89-b2d9-bd7efe911d43 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a" status: 200 len: 1520 microversion: 2.1 time: 0.163567 May 26 12:47:54.009718 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 116/221] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:47:53 2022] GET /compute/v2.1/servers/c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:55.016551 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-f07f7661-51a8-4ca4-b3ad-452cacf4e4b0 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:55.017198 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-f07f7661-51a8-4ca4-b3ad-452cacf4e4b0 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:55.024145 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-f07f7661-51a8-4ca4-b3ad-452cacf4e4b0 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:55.024937 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-f07f7661-51a8-4ca4-b3ad-452cacf4e4b0 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:55.025490 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-f07f7661-51a8-4ca4-b3ad-452cacf4e4b0 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:55.026031 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-f07f7661-51a8-4ca4-b3ad-452cacf4e4b0 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:55.202685 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-f07f7661-51a8-4ca4-b3ad-452cacf4e4b0 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:55.211336 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-f07f7661-51a8-4ca4-b3ad-452cacf4e4b0 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a" status: 200 len: 1520 microversion: 2.1 time: 0.198843 May 26 12:47:55.211931 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 106/222] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:47:55 2022] GET /compute/v2.1/servers/c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a => generated 1520 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:56.229879 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-501ce510-8fb1-4076-8bff-af1fe85e02e6 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:56.230563 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-501ce510-8fb1-4076-8bff-af1fe85e02e6 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:56.237281 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-501ce510-8fb1-4076-8bff-af1fe85e02e6 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:56.237756 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-501ce510-8fb1-4076-8bff-af1fe85e02e6 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:56.238519 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-501ce510-8fb1-4076-8bff-af1fe85e02e6 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:56.238955 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-501ce510-8fb1-4076-8bff-af1fe85e02e6 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:56.384156 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-501ce510-8fb1-4076-8bff-af1fe85e02e6 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:56.392552 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-501ce510-8fb1-4076-8bff-af1fe85e02e6 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a" status: 200 len: 1520 microversion: 2.1 time: 0.167845 May 26 12:47:56.393153 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 117/223] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:47:56 2022] GET /compute/v2.1/servers/c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:57.411532 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-36bee080-0ed9-4baa-bd31-0aeb76495d30 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:57.412347 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-36bee080-0ed9-4baa-bd31-0aeb76495d30 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:57.419517 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-36bee080-0ed9-4baa-bd31-0aeb76495d30 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:57.419967 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-36bee080-0ed9-4baa-bd31-0aeb76495d30 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:57.420744 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-36bee080-0ed9-4baa-bd31-0aeb76495d30 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:57.421178 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-36bee080-0ed9-4baa-bd31-0aeb76495d30 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:57.583527 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-36bee080-0ed9-4baa-bd31-0aeb76495d30 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:57.584127 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-36bee080-0ed9-4baa-bd31-0aeb76495d30 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a" status: 200 len: 1520 microversion: 2.1 time: 0.176562 May 26 12:47:57.593826 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 107/224] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:47:57 2022] GET /compute/v2.1/servers/c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a => generated 1520 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:57.910636 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-2ec2b16f-4ef2-4a1e-8e86-e92fad1ad6ee tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:57.911386 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-2ec2b16f-4ef2-4a1e-8e86-e92fad1ad6ee tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 7ffbf048-2aa0-4656-a6cd-923b35031eaa] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:57.918860 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-2ec2b16f-4ef2-4a1e-8e86-e92fad1ad6ee tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:57.919638 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-2ec2b16f-4ef2-4a1e-8e86-e92fad1ad6ee tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:57.920452 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-2ec2b16f-4ef2-4a1e-8e86-e92fad1ad6ee tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:57.920864 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-2ec2b16f-4ef2-4a1e-8e86-e92fad1ad6ee tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:57.943773 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-2ec2b16f-4ef2-4a1e-8e86-e92fad1ad6ee tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa/ips" status: 200 len: 153 microversion: 2.20 time: 0.037042 May 26 12:47:57.979239 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 118/225] 10.222.0.41 () {60 vars in 1288 bytes} [Thu May 26 12:47:57 2022] GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa/ips => generated 153 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 12:47:58.603201 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-399075ab-bb37-45a9-9ba4-18cf3355de3f tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:58.603928 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-399075ab-bb37-45a9-9ba4-18cf3355de3f tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:58.612221 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-399075ab-bb37-45a9-9ba4-18cf3355de3f tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:58.612954 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-399075ab-bb37-45a9-9ba4-18cf3355de3f tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:58.613910 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-399075ab-bb37-45a9-9ba4-18cf3355de3f tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:58.614405 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-399075ab-bb37-45a9-9ba4-18cf3355de3f tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:58.868190 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-399075ab-bb37-45a9-9ba4-18cf3355de3f tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:47:58.877407 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-399075ab-bb37-45a9-9ba4-18cf3355de3f tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a" status: 200 len: 1520 microversion: 2.1 time: 0.279330 May 26 12:47:58.883296 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 108/226] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:47:58 2022] GET /compute/v2.1/servers/c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a => generated 1520 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:47:59.895349 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-d8783885-8cb5-4cd5-b97f-6ecf5aa26693 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:47:59.896192 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-d8783885-8cb5-4cd5-b97f-6ecf5aa26693 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:47:59.903327 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-d8783885-8cb5-4cd5-b97f-6ecf5aa26693 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:59.903799 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-d8783885-8cb5-4cd5-b97f-6ecf5aa26693 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:47:59.904540 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-d8783885-8cb5-4cd5-b97f-6ecf5aa26693 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:47:59.904966 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-d8783885-8cb5-4cd5-b97f-6ecf5aa26693 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:00.083377 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-d8783885-8cb5-4cd5-b97f-6ecf5aa26693 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:00.093380 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-d8783885-8cb5-4cd5-b97f-6ecf5aa26693 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a" status: 200 len: 1520 microversion: 2.1 time: 0.201188 May 26 12:48:00.094440 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 119/227] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:47:59 2022] GET /compute/v2.1/servers/c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a => generated 1520 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:01.112459 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-4dc2deab-4aee-40c6-9a4e-c18a6c28465f tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:01.113126 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-4dc2deab-4aee-40c6-9a4e-c18a6c28465f tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:01.120675 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-4dc2deab-4aee-40c6-9a4e-c18a6c28465f tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:01.121354 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-4dc2deab-4aee-40c6-9a4e-c18a6c28465f tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:01.122258 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-4dc2deab-4aee-40c6-9a4e-c18a6c28465f tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:01.122692 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-4dc2deab-4aee-40c6-9a4e-c18a6c28465f tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:01.260321 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-4dc2deab-4aee-40c6-9a4e-c18a6c28465f tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:01.269956 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-4dc2deab-4aee-40c6-9a4e-c18a6c28465f tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a" status: 200 len: 1520 microversion: 2.1 time: 0.161350 May 26 12:48:01.270595 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 109/228] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:48:01 2022] GET /compute/v2.1/servers/c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:01.421912 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-3834be9e-5fad-4c80-86e7-56cbbee6ec71 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:48:01.422838 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-3834be9e-5fad-4c80-86e7-56cbbee6ec71 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 7ffbf048-2aa0-4656-a6cd-923b35031eaa] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:01.432290 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-3834be9e-5fad-4c80-86e7-56cbbee6ec71 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:01.432927 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-3834be9e-5fad-4c80-86e7-56cbbee6ec71 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:01.434005 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-3834be9e-5fad-4c80-86e7-56cbbee6ec71 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:01.434671 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-3834be9e-5fad-4c80-86e7-56cbbee6ec71 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:01.475785 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.objects.instance [None req-3834be9e-5fad-4c80-86e7-56cbbee6ec71 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lazy-loading 'flavor' on Instance uuid 7ffbf048-2aa0-4656-a6cd-923b35031eaa {{(pid=124823) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:48:02.287264 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-0ccb79d9-9419-4fc1-9643-ec80bf4d6212 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:02.287949 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-0ccb79d9-9419-4fc1-9643-ec80bf4d6212 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:02.294331 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-0ccb79d9-9419-4fc1-9643-ec80bf4d6212 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:02.294816 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-0ccb79d9-9419-4fc1-9643-ec80bf4d6212 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:02.295614 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-0ccb79d9-9419-4fc1-9643-ec80bf4d6212 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:02.296049 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-0ccb79d9-9419-4fc1-9643-ec80bf4d6212 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:02.364488 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-3834be9e-5fad-4c80-86e7-56cbbee6ec71 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "POST /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa/action" status: 202 len: 0 microversion: 2.20 time: 0.949483 May 26 12:48:02.365237 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 120/229] 10.222.0.41 () {62 vars in 1318 bytes} [Thu May 26 12:48:01 2022] POST /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa/action => generated 0 bytes in 952 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 26 12:48:02.375600 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-a1771f15-9dc3-40da-ac0c-d93cae219a36 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:02.376286 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-a1771f15-9dc3-40da-ac0c-d93cae219a36 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 7ffbf048-2aa0-4656-a6cd-923b35031eaa] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:02.383534 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-a1771f15-9dc3-40da-ac0c-d93cae219a36 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:02.383975 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-a1771f15-9dc3-40da-ac0c-d93cae219a36 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:02.385104 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-a1771f15-9dc3-40da-ac0c-d93cae219a36 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:02.385479 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-a1771f15-9dc3-40da-ac0c-d93cae219a36 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:02.436282 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-0ccb79d9-9419-4fc1-9643-ec80bf4d6212 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:02.445015 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-0ccb79d9-9419-4fc1-9643-ec80bf4d6212 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a" status: 200 len: 1520 microversion: 2.1 time: 0.160925 May 26 12:48:02.445628 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 110/230] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:48:02 2022] GET /compute/v2.1/servers/c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:48:02.528947 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-a1771f15-9dc3-40da-ac0c-d93cae219a36 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:02.537446 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-a1771f15-9dc3-40da-ac0c-d93cae219a36 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:02.539003 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-a1771f15-9dc3-40da-ac0c-d93cae219a36 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:02.540456 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-a1771f15-9dc3-40da-ac0c-d93cae219a36 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa" status: 200 len: 1723 microversion: 2.20 time: 0.169199 May 26 12:48:02.541021 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 121/231] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:48:02 2022] GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:48:03.462614 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-d5abddd3-da76-4e13-b260-13b792495c3f tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:03.463222 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-d5abddd3-da76-4e13-b260-13b792495c3f tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:03.469342 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-d5abddd3-da76-4e13-b260-13b792495c3f tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:03.469811 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-d5abddd3-da76-4e13-b260-13b792495c3f tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:03.470661 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-d5abddd3-da76-4e13-b260-13b792495c3f tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:03.471144 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-d5abddd3-da76-4e13-b260-13b792495c3f tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:03.559137 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-cba941a6-0aa8-44c3-bbaa-9a7dcb33d836 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:03.559748 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-cba941a6-0aa8-44c3-bbaa-9a7dcb33d836 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 7ffbf048-2aa0-4656-a6cd-923b35031eaa] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:03.566785 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-cba941a6-0aa8-44c3-bbaa-9a7dcb33d836 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:03.567266 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-cba941a6-0aa8-44c3-bbaa-9a7dcb33d836 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:03.568117 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-cba941a6-0aa8-44c3-bbaa-9a7dcb33d836 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:03.568720 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-cba941a6-0aa8-44c3-bbaa-9a7dcb33d836 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:03.607167 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-d5abddd3-da76-4e13-b260-13b792495c3f tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:03.624992 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-d5abddd3-da76-4e13-b260-13b792495c3f tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a" status: 200 len: 1520 microversion: 2.1 time: 0.156991 May 26 12:48:03.624992 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 111/232] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:48:03 2022] GET /compute/v2.1/servers/c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:03.706760 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-cba941a6-0aa8-44c3-bbaa-9a7dcb33d836 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:03.715709 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-cba941a6-0aa8-44c3-bbaa-9a7dcb33d836 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:03.717219 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-cba941a6-0aa8-44c3-bbaa-9a7dcb33d836 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:03.718440 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-cba941a6-0aa8-44c3-bbaa-9a7dcb33d836 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa" status: 200 len: 1723 microversion: 2.20 time: 0.163242 May 26 12:48:03.718999 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 122/233] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:48:03 2022] GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:48:04.632140 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-70315f14-35e1-4884-add6-91c411b1c942 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:04.632796 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-70315f14-35e1-4884-add6-91c411b1c942 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:04.638750 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-70315f14-35e1-4884-add6-91c411b1c942 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:04.639186 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-70315f14-35e1-4884-add6-91c411b1c942 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:04.640063 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-70315f14-35e1-4884-add6-91c411b1c942 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:04.640491 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-70315f14-35e1-4884-add6-91c411b1c942 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:04.737509 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-22893e97-3032-4585-bbc3-deb763d12e75 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:04.738464 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-22893e97-3032-4585-bbc3-deb763d12e75 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 7ffbf048-2aa0-4656-a6cd-923b35031eaa] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:04.745352 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-22893e97-3032-4585-bbc3-deb763d12e75 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:04.746073 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-22893e97-3032-4585-bbc3-deb763d12e75 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:04.747745 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-22893e97-3032-4585-bbc3-deb763d12e75 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:04.747745 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-22893e97-3032-4585-bbc3-deb763d12e75 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:04.775361 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-70315f14-35e1-4884-add6-91c411b1c942 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:04.783211 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-70315f14-35e1-4884-add6-91c411b1c942 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a" status: 200 len: 1520 microversion: 2.1 time: 0.154822 May 26 12:48:04.783803 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 112/234] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:48:04 2022] GET /compute/v2.1/servers/c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:48:04.881188 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-22893e97-3032-4585-bbc3-deb763d12e75 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:04.890044 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-22893e97-3032-4585-bbc3-deb763d12e75 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:04.891470 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-22893e97-3032-4585-bbc3-deb763d12e75 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:04.892757 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-22893e97-3032-4585-bbc3-deb763d12e75 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa" status: 200 len: 1723 microversion: 2.20 time: 0.159236 May 26 12:48:04.893320 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 123/235] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:48:04 2022] GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:48:05.473815 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-204f75bd-0477-4ab9-ac1a-f6903860852d tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:05.474229 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-204f75bd-0477-4ab9-ac1a-f6903860852d tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: 1a852e3a-0d2b-470a-a429-b4bac6aa8e6b] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:05.480689 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-204f75bd-0477-4ab9-ac1a-f6903860852d tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:05.491520 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-204f75bd-0477-4ab9-ac1a-f6903860852d tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:05.491520 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-204f75bd-0477-4ab9-ac1a-f6903860852d tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:05.491520 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-204f75bd-0477-4ab9-ac1a-f6903860852d tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:05.507594 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-204f75bd-0477-4ab9-ac1a-f6903860852d tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "GET /compute/v2.1/servers/1a852e3a-0d2b-470a-a429-b4bac6aa8e6b/ips" status: 200 len: 148 microversion: 2.1 time: 0.037116 May 26 12:48:05.508199 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 113/236] 10.222.0.41 () {58 vars in 1247 bytes} [Thu May 26 12:48:05 2022] GET /compute/v2.1/servers/1a852e3a-0d2b-470a-a429-b4bac6aa8e6b/ips => generated 148 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:48:05.800831 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-eee45f74-0aa2-4317-bd0b-73e303f75e85 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:05.801419 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-eee45f74-0aa2-4317-bd0b-73e303f75e85 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:05.808777 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-eee45f74-0aa2-4317-bd0b-73e303f75e85 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:05.809220 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-eee45f74-0aa2-4317-bd0b-73e303f75e85 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:05.810028 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-eee45f74-0aa2-4317-bd0b-73e303f75e85 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:05.810451 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-eee45f74-0aa2-4317-bd0b-73e303f75e85 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:05.914942 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-74878f32-6307-43c4-82fe-b3a365943dd0 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:05.915715 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-74878f32-6307-43c4-82fe-b3a365943dd0 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 7ffbf048-2aa0-4656-a6cd-923b35031eaa] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:05.923412 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-74878f32-6307-43c4-82fe-b3a365943dd0 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:05.923412 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-74878f32-6307-43c4-82fe-b3a365943dd0 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:05.923722 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-74878f32-6307-43c4-82fe-b3a365943dd0 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:05.924159 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-74878f32-6307-43c4-82fe-b3a365943dd0 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:05.956816 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-eee45f74-0aa2-4317-bd0b-73e303f75e85 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:05.964428 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-eee45f74-0aa2-4317-bd0b-73e303f75e85 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a" status: 200 len: 1520 microversion: 2.1 time: 0.167456 May 26 12:48:05.965016 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 124/237] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:48:05 2022] GET /compute/v2.1/servers/c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:06.074219 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-74878f32-6307-43c4-82fe-b3a365943dd0 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:06.082637 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-74878f32-6307-43c4-82fe-b3a365943dd0 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:06.084133 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-74878f32-6307-43c4-82fe-b3a365943dd0 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:06.086507 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-74878f32-6307-43c4-82fe-b3a365943dd0 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa" status: 200 len: 1723 microversion: 2.20 time: 0.175968 May 26 12:48:06.086507 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 114/238] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:48:05 2022] GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:48:06.981547 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-42dbdfb9-848c-441a-a3c6-063ddb74a20c tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:06.982178 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-42dbdfb9-848c-441a-a3c6-063ddb74a20c tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:06.988767 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-42dbdfb9-848c-441a-a3c6-063ddb74a20c tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:06.991908 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-42dbdfb9-848c-441a-a3c6-063ddb74a20c tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:06.991908 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-42dbdfb9-848c-441a-a3c6-063ddb74a20c tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:06.991908 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-42dbdfb9-848c-441a-a3c6-063ddb74a20c tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:07.104926 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-1b95ec2d-19c0-4ba5-9a70-d0c5771577bc tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:07.105526 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-1b95ec2d-19c0-4ba5-9a70-d0c5771577bc tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 7ffbf048-2aa0-4656-a6cd-923b35031eaa] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:07.107572 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG dbcounter [-] [124824] Writing DB stats nova_api:SELECT=38 {{(pid=124824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:07.112362 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-1b95ec2d-19c0-4ba5-9a70-d0c5771577bc tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:07.112860 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-1b95ec2d-19c0-4ba5-9a70-d0c5771577bc tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:07.113620 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-1b95ec2d-19c0-4ba5-9a70-d0c5771577bc tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:07.114287 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-1b95ec2d-19c0-4ba5-9a70-d0c5771577bc tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:07.124153 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-42dbdfb9-848c-441a-a3c6-063ddb74a20c tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:07.132362 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-42dbdfb9-848c-441a-a3c6-063ddb74a20c tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a" status: 200 len: 1520 microversion: 2.1 time: 0.154333 May 26 12:48:07.132931 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 125/239] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:48:06 2022] GET /compute/v2.1/servers/c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:07.244785 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-1b95ec2d-19c0-4ba5-9a70-d0c5771577bc tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:07.252884 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-1b95ec2d-19c0-4ba5-9a70-d0c5771577bc tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:07.254411 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-1b95ec2d-19c0-4ba5-9a70-d0c5771577bc tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:07.255571 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-1b95ec2d-19c0-4ba5-9a70-d0c5771577bc tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa" status: 200 len: 1723 microversion: 2.20 time: 0.154720 May 26 12:48:07.256127 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 115/240] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:48:07 2022] GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:48:08.150349 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-f00f1b85-4272-49b5-9d10-7ee3a6853cfc tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:08.150967 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-f00f1b85-4272-49b5-9d10-7ee3a6853cfc tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:08.157907 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-f00f1b85-4272-49b5-9d10-7ee3a6853cfc tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:08.162313 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-f00f1b85-4272-49b5-9d10-7ee3a6853cfc tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:08.162313 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-f00f1b85-4272-49b5-9d10-7ee3a6853cfc tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:08.162313 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-f00f1b85-4272-49b5-9d10-7ee3a6853cfc tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:08.277710 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-d99870c4-a481-44eb-8345-644d241aee42 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:08.280579 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-d99870c4-a481-44eb-8345-644d241aee42 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 7ffbf048-2aa0-4656-a6cd-923b35031eaa] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:08.288664 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-d99870c4-a481-44eb-8345-644d241aee42 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:08.289545 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-d99870c4-a481-44eb-8345-644d241aee42 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:08.290575 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-d99870c4-a481-44eb-8345-644d241aee42 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:08.291155 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-d99870c4-a481-44eb-8345-644d241aee42 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:08.300173 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-f00f1b85-4272-49b5-9d10-7ee3a6853cfc tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:08.318379 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-f00f1b85-4272-49b5-9d10-7ee3a6853cfc tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a" status: 200 len: 1520 microversion: 2.1 time: 0.172295 May 26 12:48:08.318745 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 126/241] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:48:08 2022] GET /compute/v2.1/servers/c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:08.441149 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-d99870c4-a481-44eb-8345-644d241aee42 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:08.443476 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG dbcounter [-] [124824] Writing DB stats nova_cell1:SELECT=100 {{(pid=124824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:08.450137 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-d99870c4-a481-44eb-8345-644d241aee42 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:08.451638 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-d99870c4-a481-44eb-8345-644d241aee42 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:08.452908 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-d99870c4-a481-44eb-8345-644d241aee42 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa" status: 200 len: 1723 microversion: 2.20 time: 0.181888 May 26 12:48:08.453396 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 116/242] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:48:08 2022] GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa => generated 1723 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:48:09.335803 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-fd4f695e-9b95-43ba-9ee1-a9831943fb9f tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:09.336407 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-fd4f695e-9b95-43ba-9ee1-a9831943fb9f tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:09.343253 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-fd4f695e-9b95-43ba-9ee1-a9831943fb9f tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:09.343704 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-fd4f695e-9b95-43ba-9ee1-a9831943fb9f tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:09.344533 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-fd4f695e-9b95-43ba-9ee1-a9831943fb9f tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:09.344963 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-fd4f695e-9b95-43ba-9ee1-a9831943fb9f tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:09.472562 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-8203d8da-e2f0-48fb-be47-7c0d227be7b3 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:09.473449 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-8203d8da-e2f0-48fb-be47-7c0d227be7b3 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 7ffbf048-2aa0-4656-a6cd-923b35031eaa] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:09.491695 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-8203d8da-e2f0-48fb-be47-7c0d227be7b3 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:09.491695 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-8203d8da-e2f0-48fb-be47-7c0d227be7b3 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:09.491695 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-8203d8da-e2f0-48fb-be47-7c0d227be7b3 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:09.491695 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-8203d8da-e2f0-48fb-be47-7c0d227be7b3 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:09.496509 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-fd4f695e-9b95-43ba-9ee1-a9831943fb9f tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:09.496675 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-fd4f695e-9b95-43ba-9ee1-a9831943fb9f tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a" status: 200 len: 1520 microversion: 2.1 time: 0.165221 May 26 12:48:09.497586 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 127/243] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:48:09 2022] GET /compute/v2.1/servers/c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:09.619481 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-8203d8da-e2f0-48fb-be47-7c0d227be7b3 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:09.628062 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-8203d8da-e2f0-48fb-be47-7c0d227be7b3 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:09.629562 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-8203d8da-e2f0-48fb-be47-7c0d227be7b3 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:09.630820 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-8203d8da-e2f0-48fb-be47-7c0d227be7b3 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa" status: 200 len: 1723 microversion: 2.20 time: 0.162631 May 26 12:48:09.636966 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 117/244] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:48:09 2022] GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:48:10.515143 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-3843f8e5-30fc-49ee-b4cf-185e9f44a809 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:10.515750 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-3843f8e5-30fc-49ee-b4cf-185e9f44a809 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:10.530102 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-3843f8e5-30fc-49ee-b4cf-185e9f44a809 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:10.530623 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-3843f8e5-30fc-49ee-b4cf-185e9f44a809 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:10.531620 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-3843f8e5-30fc-49ee-b4cf-185e9f44a809 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:10.532122 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-3843f8e5-30fc-49ee-b4cf-185e9f44a809 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:10.561455 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-46343bba-6844-4263-b8f8-362ab6b80d57 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "34f39cb2-c3fa-438e-9ba8-8aebf0964834"}} {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:48:10.568023 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-46343bba-6844-4263-b8f8-362ab6b80d57 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: 1a852e3a-0d2b-470a-a429-b4bac6aa8e6b] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:10.569370 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-46343bba-6844-4263-b8f8-362ab6b80d57 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:10.569855 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-46343bba-6844-4263-b8f8-362ab6b80d57 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:10.570651 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-46343bba-6844-4263-b8f8-362ab6b80d57 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:10.571087 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-46343bba-6844-4263-b8f8-362ab6b80d57 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:10.673673 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-3843f8e5-30fc-49ee-b4cf-185e9f44a809 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:10.682045 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-3843f8e5-30fc-49ee-b4cf-185e9f44a809 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a" status: 200 len: 1520 microversion: 2.1 time: 0.171843 May 26 12:48:10.687545 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 128/245] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:48:10 2022] GET /compute/v2.1/servers/c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:10.687545 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-cd0c91ec-4ab7-4311-8d2e-835e8281617d tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:10.688543 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-cd0c91ec-4ab7-4311-8d2e-835e8281617d tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 7ffbf048-2aa0-4656-a6cd-923b35031eaa] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:10.695131 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-cd0c91ec-4ab7-4311-8d2e-835e8281617d tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:10.695574 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-cd0c91ec-4ab7-4311-8d2e-835e8281617d tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:10.696329 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-cd0c91ec-4ab7-4311-8d2e-835e8281617d tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:10.696759 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-cd0c91ec-4ab7-4311-8d2e-835e8281617d tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:10.715932 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG dbcounter [-] [124823] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:10.830940 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-cd0c91ec-4ab7-4311-8d2e-835e8281617d tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:10.840620 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-cd0c91ec-4ab7-4311-8d2e-835e8281617d tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:10.842293 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-cd0c91ec-4ab7-4311-8d2e-835e8281617d tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:10.843466 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-cd0c91ec-4ab7-4311-8d2e-835e8281617d tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa" status: 200 len: 1723 microversion: 2.20 time: 0.160076 May 26 12:48:10.844037 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 129/246] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:48:10 2022] GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:48:11.699288 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-35828b59-5c8c-4c5e-9466-31fe75377508 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:11.707401 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-35828b59-5c8c-4c5e-9466-31fe75377508 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:11.708237 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-35828b59-5c8c-4c5e-9466-31fe75377508 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:11.708686 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-35828b59-5c8c-4c5e-9466-31fe75377508 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:11.709453 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-35828b59-5c8c-4c5e-9466-31fe75377508 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:11.710475 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-35828b59-5c8c-4c5e-9466-31fe75377508 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:11.858905 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-35828b59-5c8c-4c5e-9466-31fe75377508 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:11.866832 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-35828b59-5c8c-4c5e-9466-31fe75377508 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a" status: 200 len: 1520 microversion: 2.1 time: 0.171397 May 26 12:48:11.867409 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 130/247] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:48:11 2022] GET /compute/v2.1/servers/c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:48:11.872118 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-c0a2e08a-dd1c-4697-8cd7-b059171e5618 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:11.872715 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-c0a2e08a-dd1c-4697-8cd7-b059171e5618 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 7ffbf048-2aa0-4656-a6cd-923b35031eaa] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:11.879915 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-c0a2e08a-dd1c-4697-8cd7-b059171e5618 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:11.880423 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-c0a2e08a-dd1c-4697-8cd7-b059171e5618 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:11.881223 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-c0a2e08a-dd1c-4697-8cd7-b059171e5618 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:11.882184 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-c0a2e08a-dd1c-4697-8cd7-b059171e5618 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:11.898494 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-46343bba-6844-4263-b8f8-362ab6b80d57 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "POST /compute/v2.1/servers/1a852e3a-0d2b-470a-a429-b4bac6aa8e6b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.340686 May 26 12:48:11.899180 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 118/248] 10.222.0.41 () {60 vars in 1322 bytes} [Thu May 26 12:48:10 2022] POST /compute/v2.1/servers/1a852e3a-0d2b-470a-a429-b4bac6aa8e6b/os-volume_attachments => generated 194 bytes in 1342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:48:12.022744 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-c0a2e08a-dd1c-4697-8cd7-b059171e5618 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:12.034862 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-c0a2e08a-dd1c-4697-8cd7-b059171e5618 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:12.036731 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-c0a2e08a-dd1c-4697-8cd7-b059171e5618 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:12.038331 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-c0a2e08a-dd1c-4697-8cd7-b059171e5618 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa" status: 200 len: 1723 microversion: 2.20 time: 0.169581 May 26 12:48:12.039247 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 131/249] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:48:11 2022] GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:48:12.885922 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-1168aa56-793d-452d-86f0-b10628f0de04 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:12.886615 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-1168aa56-793d-452d-86f0-b10628f0de04 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:12.894187 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-1168aa56-793d-452d-86f0-b10628f0de04 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:12.894629 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-1168aa56-793d-452d-86f0-b10628f0de04 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:12.895590 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-1168aa56-793d-452d-86f0-b10628f0de04 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:12.896072 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-1168aa56-793d-452d-86f0-b10628f0de04 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:13.035034 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-1168aa56-793d-452d-86f0-b10628f0de04 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:13.043267 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-1168aa56-793d-452d-86f0-b10628f0de04 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a" status: 200 len: 1520 microversion: 2.1 time: 0.162742 May 26 12:48:13.043865 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 119/250] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:48:12 2022] GET /compute/v2.1/servers/c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:13.063380 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-f116667d-894a-4fe0-bc78-8796d666c1b1 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:13.064295 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-f116667d-894a-4fe0-bc78-8796d666c1b1 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 7ffbf048-2aa0-4656-a6cd-923b35031eaa] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:13.070854 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-f116667d-894a-4fe0-bc78-8796d666c1b1 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:13.071296 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-f116667d-894a-4fe0-bc78-8796d666c1b1 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:13.072199 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-f116667d-894a-4fe0-bc78-8796d666c1b1 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:13.072487 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-f116667d-894a-4fe0-bc78-8796d666c1b1 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:13.211848 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-f116667d-894a-4fe0-bc78-8796d666c1b1 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:13.220924 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-f116667d-894a-4fe0-bc78-8796d666c1b1 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:13.224138 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-f116667d-894a-4fe0-bc78-8796d666c1b1 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:13.224138 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-f116667d-894a-4fe0-bc78-8796d666c1b1 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa" status: 200 len: 1723 microversion: 2.20 time: 0.164412 May 26 12:48:13.224349 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 132/251] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:48:13 2022] GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:48:13.753543 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-d6fa8cdc-820c-4d74-a7ce-7b5965709180 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-243661280", "imageRef": "6df25342-b071-489b-a7c1-3089fa19af6d", "flavorRef": "452", "networks": [{"uuid": "bbe92bd3-5bf4-45da-a720-98219a4012c7"}]}} {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:48:13.808125 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.network.neutron [None req-d6fa8cdc-820c-4d74-a7ce-7b5965709180 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] validate_networks() for [('bbe92bd3-5bf4-45da-a720-98219a4012c7', None, None, None, None, None)] {{(pid=124824) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 12:48:14.060424 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-2d41d7f2-330b-46fa-a5d3-cfe3da7933b6 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:14.061120 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-2d41d7f2-330b-46fa-a5d3-cfe3da7933b6 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:14.072871 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-2d41d7f2-330b-46fa-a5d3-cfe3da7933b6 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:14.072871 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-2d41d7f2-330b-46fa-a5d3-cfe3da7933b6 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:14.072871 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-2d41d7f2-330b-46fa-a5d3-cfe3da7933b6 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:14.072871 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-2d41d7f2-330b-46fa-a5d3-cfe3da7933b6 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:14.170333 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.virt.hardware [None req-d6fa8cdc-820c-4d74-a7ce-7b5965709180 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Flavor limits 0:0:0 {{(pid=124824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 12:48:14.170333 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.virt.hardware [None req-d6fa8cdc-820c-4d74-a7ce-7b5965709180 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Image limits 0:0:0 {{(pid=124824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 12:48:14.170333 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.virt.hardware [None req-d6fa8cdc-820c-4d74-a7ce-7b5965709180 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Flavor pref 0:0:0 {{(pid=124824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 12:48:14.170333 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.virt.hardware [None req-d6fa8cdc-820c-4d74-a7ce-7b5965709180 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Image pref 0:0:0 {{(pid=124824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 12:48:14.170333 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.virt.hardware [None req-d6fa8cdc-820c-4d74-a7ce-7b5965709180 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 12:48:14.178981 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-d6fa8cdc-820c-4d74-a7ce-7b5965709180 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:14.179421 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-d6fa8cdc-820c-4d74-a7ce-7b5965709180 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:14.180203 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-d6fa8cdc-820c-4d74-a7ce-7b5965709180 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:14.180631 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-d6fa8cdc-820c-4d74-a7ce-7b5965709180 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:14.197930 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.quota [None req-d6fa8cdc-820c-4d74-a7ce-7b5965709180 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Getting quotas for project d539dfec943a44eb9b025d842a1f858d. Resources: {'instances', 'ram', 'cores'} {{(pid=124824) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:48:14.203551 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.quota [None req-d6fa8cdc-820c-4d74-a7ce-7b5965709180 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Getting quotas for user 646a9abb1f9d4a1295a04defd895ff7c and project d539dfec943a44eb9b025d842a1f858d. Resources: {'instances', 'ram', 'cores'} {{(pid=124824) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:48:14.204249 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-2d41d7f2-330b-46fa-a5d3-cfe3da7933b6 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:14.212360 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-2d41d7f2-330b-46fa-a5d3-cfe3da7933b6 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a" status: 200 len: 1500 microversion: 2.1 time: 0.156072 May 26 12:48:14.216158 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 133/252] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:48:14 2022] GET /compute/v2.1/servers/c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a => generated 1500 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:48:14.216923 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-d6fa8cdc-820c-4d74-a7ce-7b5965709180 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Going to run 1 instances... {{(pid=124824) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 12:48:14.219334 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-d6fa8cdc-820c-4d74-a7ce-7b5965709180 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] [instance: 9c87b8e9-adf1-40f0-b5d1-6efa2f25ab63] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6df25342-b071-489b-a7c1-3089fa19af6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124824) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 12:48:14.229549 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-be80fa4d-fc82-4537-8339-e93aa886714b tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "338d4f2f-963c-46b6-8fcd-67e43e6100fa"}} {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:48:14.230889 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-be80fa4d-fc82-4537-8339-e93aa886714b tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:14.237140 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-be80fa4d-fc82-4537-8339-e93aa886714b tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:14.237918 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-be80fa4d-fc82-4537-8339-e93aa886714b tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:14.238782 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-be80fa4d-fc82-4537-8339-e93aa886714b tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:14.239282 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-be80fa4d-fc82-4537-8339-e93aa886714b tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:14.262975 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.wsgi [None req-be80fa4d-fc82-4537-8339-e93aa886714b tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] HTTP exception thrown: Cannot 'attach_volume' instance c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a while it is in vm_state rescued May 26 12:48:14.264648 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-be80fa4d-fc82-4537-8339-e93aa886714b tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Request method failure captured: May 26 12:48:14.264648 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: request: POST /compute/v2.1/servers/c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a/os-volume_attachments HTTP/1.1 May 26 12:48:14.264648 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Accept: application/json May 26 12:48:14.264648 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Accept-Encoding: identity May 26 12:48:14.264648 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Connection: close May 26 12:48:14.264648 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Content-Length: 74 May 26 12:48:14.264648 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Content-Type: application/json May 26 12:48:14.264648 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Host: 10.222.0.41 May 26 12:48:14.264648 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Openstack-System-Scope: None May 26 12:48:14.264648 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: User-Agent: python-urllib3/1.26.9 May 26 12:48:14.264648 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Auth-Token: gAAAAABij3aX6bwsviEkeUYewj-xlndiK1bsPBf92DMS42pl4gfoAWpT2Nwqjxg-XMZou9-CFzmPCmtZ9TjM3zfCdG4bAle_MvCdrJrquNKcFpkWDFLqcD6Kq3oa26r5AlaY0DKFiwUUVBB5lqaRpwXOXIz3ew4L1IUMZ8-eR1xMR1hG_1d6fpk May 26 12:48:14.264648 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Domain-Id: None May 26 12:48:14.264648 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Domain-Name: None May 26 12:48:14.264648 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Identity-Status: Confirmed May 26 12:48:14.264648 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Is-Admin-Project: True May 26 12:48:14.264648 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Project-Domain-Id: default May 26 12:48:14.264648 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Project-Domain-Name: Default May 26 12:48:14.264648 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Project-Id: 9930a0f4448d4ef0a6030da17a36257a May 26 12:48:14.264648 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1873359870 May 26 12:48:14.264648 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Role: member,reader May 26 12:48:14.264648 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Roles: member,reader May 26 12:48:14.266008 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/9930a0f4448d4ef0a6030da17a36257a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/9930a0f4448d4ef0a6030da17a36257a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/9930a0f4448d4ef0a6030da17a36257a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_9930a0f4448d4ef0a6030da17a36257a", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 26 12:48:14.266008 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1873359870 May 26 12:48:14.266008 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Tenant-Id: 9930a0f4448d4ef0a6030da17a36257a May 26 12:48:14.266008 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1873359870 May 26 12:48:14.266008 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User: tempest-ServerRescueNegativeTestJSON-1873359870-project May 26 12:48:14.266008 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User-Domain-Id: default May 26 12:48:14.266008 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User-Domain-Name: Default May 26 12:48:14.266008 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User-Id: cf98a4d33cab49b08640f437dbfb2dc8 May 26 12:48:14.266008 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1873359870-project May 26 12:48:14.266008 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: May 26 12:48:14.266008 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: {"volumeAttachment": {"volumeId": "338d4f2f-963c-46b6-8fcd-67e43e6100fa"}} May 26 12:48:14.266008 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: method: > May 26 12:48:14.266679 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: exception: Cannot 'attach_volume' instance c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a while it is in vm_state rescued May 26 12:48:14.266679 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: action_args: {'server_id': 'c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a', 'body': {'volumeAttachment': {'volumeId': '338d4f2f-963c-46b6-8fcd-67e43e6100fa'}}} May 26 12:48:14.266679 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:48:14.266679 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:48:14.266679 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 26 12:48:14.266679 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 26 12:48:14.266679 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 26 12:48:14.266679 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 12:48:14.266679 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 26 12:48:14.266679 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 26 12:48:14.266679 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a in vm_state rescued. Cannot attach_volume while the instance is in this state. May 26 12:48:14.266679 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:48:14.266679 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:48:14.266679 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:48:14.266679 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:48:14.266679 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:48:14.266679 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:48:14.266679 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:48:14.266679 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:48:14.267778 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:48:14.267778 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:48:14.267778 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 12:48:14.267778 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 12:48:14.267778 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 12:48:14.267778 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 12:48:14.267778 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 12:48:14.267778 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 12:48:14.267778 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 26 12:48:14.267778 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 26 12:48:14.267778 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 26 12:48:14.267778 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 26 12:48:14.267778 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a while it is in vm_state rescued May 26 12:48:14.267778 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:48:14.267778 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:48:14.267778 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:48:14.267778 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:48:14.267778 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:48:14.267778 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:48:14.267778 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:48:14.268816 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:48:14.268816 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a while it is in vm_state rescued May 26 12:48:14.268816 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:48:14.268816 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-be80fa4d-fc82-4537-8339-e93aa886714b tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Returning 409 to user: Cannot 'attach_volume' instance c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a while it is in vm_state rescued {{(pid=124823) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:48:14.268816 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-be80fa4d-fc82-4537-8339-e93aa886714b tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "POST /compute/v2.1/servers/c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.041187 May 26 12:48:14.268816 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 134/253] 10.222.0.41 () {60 vars in 1322 bytes} [Thu May 26 12:48:14 2022] POST /compute/v2.1/servers/c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a/os-volume_attachments => generated 152 bytes in 42 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) May 26 12:48:14.270867 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-d82836bd-299e-46f7-956a-3897017c27da tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:14.271508 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-d82836bd-299e-46f7-956a-3897017c27da tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 7ffbf048-2aa0-4656-a6cd-923b35031eaa] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:14.277238 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-d82836bd-299e-46f7-956a-3897017c27da tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:14.277760 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-d82836bd-299e-46f7-956a-3897017c27da tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:14.278482 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-d82836bd-299e-46f7-956a-3897017c27da tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:14.278914 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-d82836bd-299e-46f7-956a-3897017c27da tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:14.407168 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-d6fa8cdc-820c-4d74-a7ce-7b5965709180 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.657561 May 26 12:48:14.407819 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 120/254] 10.222.0.41 () {60 vars in 1146 bytes} [Thu May 26 12:48:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 659 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 26 12:48:14.413574 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-b4604c4d-ad8d-4ea9-b9b7-0329ba5f64b3 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:48:14.414431 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-b4604c4d-ad8d-4ea9-b9b7-0329ba5f64b3 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:14.420589 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-b4604c4d-ad8d-4ea9-b9b7-0329ba5f64b3 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:14.420799 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-d82836bd-299e-46f7-956a-3897017c27da tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:14.421033 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-b4604c4d-ad8d-4ea9-b9b7-0329ba5f64b3 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:14.421993 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-b4604c4d-ad8d-4ea9-b9b7-0329ba5f64b3 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:14.422592 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-b4604c4d-ad8d-4ea9-b9b7-0329ba5f64b3 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:14.430493 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-d82836bd-299e-46f7-956a-3897017c27da tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:14.431963 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-d82836bd-299e-46f7-956a-3897017c27da tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:14.433123 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-d82836bd-299e-46f7-956a-3897017c27da tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa" status: 200 len: 1723 microversion: 2.20 time: 0.165669 May 26 12:48:14.433756 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 135/255] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:48:14 2022] GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:48:14.438542 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-b244a63d-4d1f-4daa-878d-d47d44f07174 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:14.439156 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-b244a63d-4d1f-4daa-878d-d47d44f07174 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] [instance: 9c87b8e9-adf1-40f0-b5d1-6efa2f25ab63] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:14.495382 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-b244a63d-4d1f-4daa-878d-d47d44f07174 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646a9abb1f9d4a1295a04defd895ff7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd539dfec943a44eb9b025d842a1f858d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:14.505329 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-b244a63d-4d1f-4daa-878d-d47d44f07174 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] 10.222.0.41 "GET /compute/v2.1/servers/9c87b8e9-adf1-40f0-b5d1-6efa2f25ab63" status: 200 len: 1218 microversion: 2.1 time: 0.067911 May 26 12:48:14.505329 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 136/256] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:48:14 2022] GET /compute/v2.1/servers/9c87b8e9-adf1-40f0-b5d1-6efa2f25ab63 => generated 1218 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:14.800364 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-b4604c4d-ad8d-4ea9-b9b7-0329ba5f64b3 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "POST /compute/v2.1/servers/c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a/action" status: 202 len: 0 microversion: 2.1 time: 0.390902 May 26 12:48:14.801134 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 121/257] 10.222.0.41 () {60 vars in 1277 bytes} [Thu May 26 12:48:14 2022] POST /compute/v2.1/servers/c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a/action => generated 0 bytes in 392 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 12:48:14.810383 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-fc9d2456-446c-4004-a341-9ed4f0290809 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:14.811003 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-fc9d2456-446c-4004-a341-9ed4f0290809 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:14.818305 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-fc9d2456-446c-4004-a341-9ed4f0290809 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:14.819331 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-fc9d2456-446c-4004-a341-9ed4f0290809 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:14.820798 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-fc9d2456-446c-4004-a341-9ed4f0290809 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:14.821237 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-fc9d2456-446c-4004-a341-9ed4f0290809 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:14.998105 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-fc9d2456-446c-4004-a341-9ed4f0290809 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:15.006147 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-fc9d2456-446c-4004-a341-9ed4f0290809 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a" status: 200 len: 1508 microversion: 2.1 time: 0.200810 May 26 12:48:15.007475 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 137/258] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:48:14 2022] GET /compute/v2.1/servers/c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a => generated 1508 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:15.454392 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-916b3c1d-9ef0-41b8-a9e0-9eb411028062 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:15.455416 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-916b3c1d-9ef0-41b8-a9e0-9eb411028062 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 7ffbf048-2aa0-4656-a6cd-923b35031eaa] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:15.463687 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-916b3c1d-9ef0-41b8-a9e0-9eb411028062 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:15.464135 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-916b3c1d-9ef0-41b8-a9e0-9eb411028062 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:15.465583 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-916b3c1d-9ef0-41b8-a9e0-9eb411028062 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:15.465583 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-916b3c1d-9ef0-41b8-a9e0-9eb411028062 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:15.519906 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-f5d8f287-e399-441c-8dd4-3524f6c98bfb tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:15.520477 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-f5d8f287-e399-441c-8dd4-3524f6c98bfb tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] [instance: 9c87b8e9-adf1-40f0-b5d1-6efa2f25ab63] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:15.523443 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG dbcounter [-] [124823] Writing DB stats nova_api:SELECT=56 {{(pid=124823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:15.574845 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-f5d8f287-e399-441c-8dd4-3524f6c98bfb tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646a9abb1f9d4a1295a04defd895ff7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd539dfec943a44eb9b025d842a1f858d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:15.582180 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-f5d8f287-e399-441c-8dd4-3524f6c98bfb tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] 10.222.0.41 "GET /compute/v2.1/servers/9c87b8e9-adf1-40f0-b5d1-6efa2f25ab63" status: 200 len: 1218 microversion: 2.1 time: 0.066231 May 26 12:48:15.582685 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 138/259] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:48:15 2022] GET /compute/v2.1/servers/9c87b8e9-adf1-40f0-b5d1-6efa2f25ab63 => generated 1218 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:48:15.598528 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-916b3c1d-9ef0-41b8-a9e0-9eb411028062 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:15.606722 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-916b3c1d-9ef0-41b8-a9e0-9eb411028062 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:15.608202 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-916b3c1d-9ef0-41b8-a9e0-9eb411028062 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:15.609344 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-916b3c1d-9ef0-41b8-a9e0-9eb411028062 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa" status: 200 len: 1723 microversion: 2.20 time: 0.161566 May 26 12:48:15.609941 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 122/260] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:48:15 2022] GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:48:16.024795 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-10c87c80-5964-4ca2-9366-e1fa5a1fc6fc tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:16.025551 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-10c87c80-5964-4ca2-9366-e1fa5a1fc6fc tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:16.036018 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-10c87c80-5964-4ca2-9366-e1fa5a1fc6fc tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:16.036018 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-10c87c80-5964-4ca2-9366-e1fa5a1fc6fc tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:16.036018 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-10c87c80-5964-4ca2-9366-e1fa5a1fc6fc tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:16.036018 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-10c87c80-5964-4ca2-9366-e1fa5a1fc6fc tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:16.167697 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-10c87c80-5964-4ca2-9366-e1fa5a1fc6fc tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:16.176581 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-10c87c80-5964-4ca2-9366-e1fa5a1fc6fc tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a" status: 200 len: 1508 microversion: 2.1 time: 0.156087 May 26 12:48:16.177456 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 139/261] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:48:16 2022] GET /compute/v2.1/servers/c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a => generated 1508 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:48:16.600027 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-8ac78848-02fc-4f3d-9ba9-d0b33cedc42b tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:16.601231 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-8ac78848-02fc-4f3d-9ba9-d0b33cedc42b tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] [instance: 9c87b8e9-adf1-40f0-b5d1-6efa2f25ab63] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:16.607813 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-8ac78848-02fc-4f3d-9ba9-d0b33cedc42b tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:16.608257 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-8ac78848-02fc-4f3d-9ba9-d0b33cedc42b tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:16.609014 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-8ac78848-02fc-4f3d-9ba9-d0b33cedc42b tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:16.609437 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-8ac78848-02fc-4f3d-9ba9-d0b33cedc42b tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:16.628507 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-ab8458da-82d9-4c76-98ee-b3a4477b0041 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:16.629116 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-ab8458da-82d9-4c76-98ee-b3a4477b0041 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 7ffbf048-2aa0-4656-a6cd-923b35031eaa] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:16.635144 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-ab8458da-82d9-4c76-98ee-b3a4477b0041 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:16.635587 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-ab8458da-82d9-4c76-98ee-b3a4477b0041 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:16.636360 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-ab8458da-82d9-4c76-98ee-b3a4477b0041 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:16.636795 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-ab8458da-82d9-4c76-98ee-b3a4477b0041 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:16.677357 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-8ac78848-02fc-4f3d-9ba9-d0b33cedc42b tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646a9abb1f9d4a1295a04defd895ff7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd539dfec943a44eb9b025d842a1f858d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:16.686730 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-8ac78848-02fc-4f3d-9ba9-d0b33cedc42b tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] 10.222.0.41 "GET /compute/v2.1/servers/9c87b8e9-adf1-40f0-b5d1-6efa2f25ab63" status: 200 len: 1222 microversion: 2.1 time: 0.090891 May 26 12:48:16.687959 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 123/262] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:48:16 2022] GET /compute/v2.1/servers/9c87b8e9-adf1-40f0-b5d1-6efa2f25ab63 => generated 1222 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:16.778498 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-ab8458da-82d9-4c76-98ee-b3a4477b0041 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:16.788867 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-ab8458da-82d9-4c76-98ee-b3a4477b0041 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:16.790695 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-ab8458da-82d9-4c76-98ee-b3a4477b0041 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:16.793783 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-ab8458da-82d9-4c76-98ee-b3a4477b0041 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa" status: 200 len: 1723 microversion: 2.20 time: 0.168118 May 26 12:48:16.793783 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 140/263] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:48:16 2022] GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:48:17.193377 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-a8f6edbe-234e-4a97-bc58-dac84d72b517 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:17.194748 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-a8f6edbe-234e-4a97-bc58-dac84d72b517 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:17.203110 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-a8f6edbe-234e-4a97-bc58-dac84d72b517 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:17.203611 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-a8f6edbe-234e-4a97-bc58-dac84d72b517 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:17.204517 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-a8f6edbe-234e-4a97-bc58-dac84d72b517 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:17.204949 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-a8f6edbe-234e-4a97-bc58-dac84d72b517 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:17.552934 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-a8f6edbe-234e-4a97-bc58-dac84d72b517 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:17.560887 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-a8f6edbe-234e-4a97-bc58-dac84d72b517 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a" status: 200 len: 1508 microversion: 2.1 time: 0.371986 May 26 12:48:17.561462 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 124/264] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:48:17 2022] GET /compute/v2.1/servers/c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a => generated 1508 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:17.704291 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-eba1f151-d1a1-4b89-a362-8b4ec86f938c tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:17.704896 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-eba1f151-d1a1-4b89-a362-8b4ec86f938c tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] [instance: 9c87b8e9-adf1-40f0-b5d1-6efa2f25ab63] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:17.711755 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-eba1f151-d1a1-4b89-a362-8b4ec86f938c tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:17.712197 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-eba1f151-d1a1-4b89-a362-8b4ec86f938c tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:17.712960 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-eba1f151-d1a1-4b89-a362-8b4ec86f938c tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:17.713387 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-eba1f151-d1a1-4b89-a362-8b4ec86f938c tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:17.775657 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-eba1f151-d1a1-4b89-a362-8b4ec86f938c tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646a9abb1f9d4a1295a04defd895ff7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd539dfec943a44eb9b025d842a1f858d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:17.783182 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-eba1f151-d1a1-4b89-a362-8b4ec86f938c tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] 10.222.0.41 "GET /compute/v2.1/servers/9c87b8e9-adf1-40f0-b5d1-6efa2f25ab63" status: 200 len: 1214 microversion: 2.1 time: 0.083009 May 26 12:48:17.784137 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 141/265] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:48:17 2022] GET /compute/v2.1/servers/9c87b8e9-adf1-40f0-b5d1-6efa2f25ab63 => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:17.810242 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-423c1e69-26c8-4437-a146-5dca26720376 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:17.811681 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-423c1e69-26c8-4437-a146-5dca26720376 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 7ffbf048-2aa0-4656-a6cd-923b35031eaa] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:17.818894 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-423c1e69-26c8-4437-a146-5dca26720376 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:17.819610 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-423c1e69-26c8-4437-a146-5dca26720376 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:17.821458 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-423c1e69-26c8-4437-a146-5dca26720376 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:17.822156 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-423c1e69-26c8-4437-a146-5dca26720376 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:17.953898 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-423c1e69-26c8-4437-a146-5dca26720376 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:17.962031 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-423c1e69-26c8-4437-a146-5dca26720376 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:17.963531 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-423c1e69-26c8-4437-a146-5dca26720376 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:17.964680 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-423c1e69-26c8-4437-a146-5dca26720376 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa" status: 200 len: 1723 microversion: 2.20 time: 0.158318 May 26 12:48:17.965232 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 125/266] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:48:17 2022] GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:48:18.578082 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-6fccbc22-ea25-45cf-9e77-fe02e0e69b60 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:18.578600 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-6fccbc22-ea25-45cf-9e77-fe02e0e69b60 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:18.585799 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-6fccbc22-ea25-45cf-9e77-fe02e0e69b60 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:18.586241 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-6fccbc22-ea25-45cf-9e77-fe02e0e69b60 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:18.587003 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-6fccbc22-ea25-45cf-9e77-fe02e0e69b60 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:18.587431 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-6fccbc22-ea25-45cf-9e77-fe02e0e69b60 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:18.724001 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-6fccbc22-ea25-45cf-9e77-fe02e0e69b60 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:18.732529 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-6fccbc22-ea25-45cf-9e77-fe02e0e69b60 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a" status: 200 len: 1514 microversion: 2.1 time: 0.158859 May 26 12:48:18.733384 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 142/267] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:48:18 2022] GET /compute/v2.1/servers/c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:18.800478 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-65542cef-516d-425a-809f-856ea47389c0 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:18.801224 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-65542cef-516d-425a-809f-856ea47389c0 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] [instance: 9c87b8e9-adf1-40f0-b5d1-6efa2f25ab63] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:18.808069 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-65542cef-516d-425a-809f-856ea47389c0 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:18.808613 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-65542cef-516d-425a-809f-856ea47389c0 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:18.809443 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-65542cef-516d-425a-809f-856ea47389c0 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:18.809977 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-65542cef-516d-425a-809f-856ea47389c0 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:18.883032 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-65542cef-516d-425a-809f-856ea47389c0 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646a9abb1f9d4a1295a04defd895ff7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd539dfec943a44eb9b025d842a1f858d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:18.890687 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-65542cef-516d-425a-809f-856ea47389c0 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] 10.222.0.41 "GET /compute/v2.1/servers/9c87b8e9-adf1-40f0-b5d1-6efa2f25ab63" status: 200 len: 1270 microversion: 2.1 time: 0.093969 May 26 12:48:18.891626 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 126/268] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:48:18 2022] GET /compute/v2.1/servers/9c87b8e9-adf1-40f0-b5d1-6efa2f25ab63 => generated 1270 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:18.983987 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-c9773f0e-7687-47b6-8fc5-0d96d72ccb43 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:18.984880 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-c9773f0e-7687-47b6-8fc5-0d96d72ccb43 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 7ffbf048-2aa0-4656-a6cd-923b35031eaa] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:18.991880 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-c9773f0e-7687-47b6-8fc5-0d96d72ccb43 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:18.998540 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-c9773f0e-7687-47b6-8fc5-0d96d72ccb43 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:18.998540 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-c9773f0e-7687-47b6-8fc5-0d96d72ccb43 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:18.998540 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-c9773f0e-7687-47b6-8fc5-0d96d72ccb43 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:19.124037 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-c9773f0e-7687-47b6-8fc5-0d96d72ccb43 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:19.132195 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-c9773f0e-7687-47b6-8fc5-0d96d72ccb43 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:19.133770 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-c9773f0e-7687-47b6-8fc5-0d96d72ccb43 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:19.134934 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-c9773f0e-7687-47b6-8fc5-0d96d72ccb43 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa" status: 200 len: 1723 microversion: 2.20 time: 0.154918 May 26 12:48:19.135495 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 143/269] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:48:18 2022] GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:48:19.907546 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-470b2e74-be7d-42cc-9c31-0240b417a2fe tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:19.908229 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-470b2e74-be7d-42cc-9c31-0240b417a2fe tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] [instance: 9c87b8e9-adf1-40f0-b5d1-6efa2f25ab63] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:19.915458 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-470b2e74-be7d-42cc-9c31-0240b417a2fe tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:19.915923 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-470b2e74-be7d-42cc-9c31-0240b417a2fe tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:19.916666 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-470b2e74-be7d-42cc-9c31-0240b417a2fe tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:19.917096 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-470b2e74-be7d-42cc-9c31-0240b417a2fe tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:20.007244 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-470b2e74-be7d-42cc-9c31-0240b417a2fe tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646a9abb1f9d4a1295a04defd895ff7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd539dfec943a44eb9b025d842a1f858d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:20.015746 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-470b2e74-be7d-42cc-9c31-0240b417a2fe tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] 10.222.0.41 "GET /compute/v2.1/servers/9c87b8e9-adf1-40f0-b5d1-6efa2f25ab63" status: 200 len: 1278 microversion: 2.1 time: 0.111696 May 26 12:48:20.016463 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 127/270] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:48:19 2022] GET /compute/v2.1/servers/9c87b8e9-adf1-40f0-b5d1-6efa2f25ab63 => generated 1278 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:20.154228 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-dc0522c3-cbc8-4c0a-85df-6b28f7ec97c7 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:20.154845 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-dc0522c3-cbc8-4c0a-85df-6b28f7ec97c7 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 7ffbf048-2aa0-4656-a6cd-923b35031eaa] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:20.161990 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-dc0522c3-cbc8-4c0a-85df-6b28f7ec97c7 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:20.162670 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-dc0522c3-cbc8-4c0a-85df-6b28f7ec97c7 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:20.163445 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-dc0522c3-cbc8-4c0a-85df-6b28f7ec97c7 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:20.164104 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-dc0522c3-cbc8-4c0a-85df-6b28f7ec97c7 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:20.368357 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-dc0522c3-cbc8-4c0a-85df-6b28f7ec97c7 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:20.376995 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-dc0522c3-cbc8-4c0a-85df-6b28f7ec97c7 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:20.377810 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-dc0522c3-cbc8-4c0a-85df-6b28f7ec97c7 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:20.378971 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-dc0522c3-cbc8-4c0a-85df-6b28f7ec97c7 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa" status: 200 len: 1723 microversion: 2.20 time: 0.228639 May 26 12:48:20.379883 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 144/271] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:48:20 2022] GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa => generated 1723 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:48:20.512185 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-ec16afdf-2dd8-41ef-83a8-23ed9e0810d1 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Action: 'create', calling method: .version_select at 0x7f26a2803550>, body: {"keypair": {"name": "tempest-keypair-399683608", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJNn9qO0X7oOSSWjOrGifVuY6ZcDg68HgBgZ73eu5ynEqFr9gPJBxMk2v2HC95KJ3QOgqw2OYf+ujGn+mDDgPuLgTsRLDHqK7yR8epKEGX2iezTRvLFoG7j19kCu1MXGGw=="}} {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:48:20.530524 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.quota [None req-ec16afdf-2dd8-41ef-83a8-23ed9e0810d1 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Getting quotas for project cad768b45d17480d8d6bbbcff6032c8d. Resources: {'key_pairs'} {{(pid=124824) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:48:20.534427 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.quota [None req-ec16afdf-2dd8-41ef-83a8-23ed9e0810d1 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Getting quotas for user 0537911b91184fcdbdcc9e93ec3fe5b9 and project cad768b45d17480d8d6bbbcff6032c8d. Resources: {'key_pairs'} {{(pid=124824) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:48:20.616151 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-ad70102f-0bca-403c-8430-5e407f37b5f1 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Action: 'create', calling method: .version_select at 0x7f26a2007550>, body: {"keypair": {"name": "tempest-keypair-1042284356", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDe68xNTyLX6Hb/jVXAsXksTuxjke4W++JcPuXYBKv4uZ8NF03DeCfcKtXimUNycoK+oEkkDPGjM9BZ/GdiA6ub6ohaep7PoPDmpX72Ce2x6EXRD0EjlK5JpJNq/uHtHMg=="}} {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:48:20.630462 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.quota [None req-ad70102f-0bca-403c-8430-5e407f37b5f1 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Getting quotas for project 9930a0f4448d4ef0a6030da17a36257a. Resources: {'key_pairs'} {{(pid=124823) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:48:20.635990 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.quota [None req-ad70102f-0bca-403c-8430-5e407f37b5f1 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Getting quotas for user cf98a4d33cab49b08640f437dbfb2dc8 and project 9930a0f4448d4ef0a6030da17a36257a. Resources: {'key_pairs'} {{(pid=124823) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:48:20.680244 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-ec16afdf-2dd8-41ef-83a8-23ed9e0810d1 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.172460 May 26 12:48:20.680919 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 128/272] 10.222.0.41 () {60 vars in 1158 bytes} [Thu May 26 12:48:20 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:48:20.777051 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-ad70102f-0bca-403c-8430-5e407f37b5f1 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.165329 May 26 12:48:20.777659 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 145/273] 10.222.0.41 () {60 vars in 1158 bytes} [Thu May 26 12:48:20 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:48:21.038488 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-6d31f522-b3ff-467b-8aa7-ceac46f5257b tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:21.039130 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-6d31f522-b3ff-467b-8aa7-ceac46f5257b tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] [instance: 9c87b8e9-adf1-40f0-b5d1-6efa2f25ab63] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:21.046036 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-6d31f522-b3ff-467b-8aa7-ceac46f5257b tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:21.046421 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-6d31f522-b3ff-467b-8aa7-ceac46f5257b tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:21.047180 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-6d31f522-b3ff-467b-8aa7-ceac46f5257b tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:21.047613 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-6d31f522-b3ff-467b-8aa7-ceac46f5257b tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:21.205142 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-6d31f522-b3ff-467b-8aa7-ceac46f5257b tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646a9abb1f9d4a1295a04defd895ff7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd539dfec943a44eb9b025d842a1f858d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:21.213090 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-6d31f522-b3ff-467b-8aa7-ceac46f5257b tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] 10.222.0.41 "GET /compute/v2.1/servers/9c87b8e9-adf1-40f0-b5d1-6efa2f25ab63" status: 200 len: 1318 microversion: 2.1 time: 0.179189 May 26 12:48:21.213659 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 129/274] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:48:21 2022] GET /compute/v2.1/servers/9c87b8e9-adf1-40f0-b5d1-6efa2f25ab63 => generated 1318 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:21.398747 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-e71e90a1-793e-48ea-9dcd-9607d3f61c37 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:21.399353 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-e71e90a1-793e-48ea-9dcd-9607d3f61c37 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 7ffbf048-2aa0-4656-a6cd-923b35031eaa] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:21.405433 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-e71e90a1-793e-48ea-9dcd-9607d3f61c37 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:21.405902 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-e71e90a1-793e-48ea-9dcd-9607d3f61c37 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:21.409213 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-e71e90a1-793e-48ea-9dcd-9607d3f61c37 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:21.409213 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-e71e90a1-793e-48ea-9dcd-9607d3f61c37 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:21.824446 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-e71e90a1-793e-48ea-9dcd-9607d3f61c37 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:21.833439 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-e71e90a1-793e-48ea-9dcd-9607d3f61c37 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:21.837400 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-e71e90a1-793e-48ea-9dcd-9607d3f61c37 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:21.837400 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-e71e90a1-793e-48ea-9dcd-9607d3f61c37 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa" status: 200 len: 1723 microversion: 2.20 time: 0.442345 May 26 12:48:21.837945 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 146/275] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:48:21 2022] GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa => generated 1723 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:48:22.146556 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [req-0cc5bb68-1fb3-44a4-9ea1-8590e2ce74a4 req-ac348003-a1e8-4de3-aeb5-ce066abb07e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c87b8e9-adf1-40f0-b5d1-6efa2f25ab63", "tag": "d06501d9-6a97-4277-a1d1-1171ea317203"}]} {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:48:22.155422 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [req-0cc5bb68-1fb3-44a4-9ea1-8590e2ce74a4 req-ac348003-a1e8-4de3-aeb5-ce066abb07e8 service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:22.155858 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [req-0cc5bb68-1fb3-44a4-9ea1-8590e2ce74a4 req-ac348003-a1e8-4de3-aeb5-ce066abb07e8 service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:22.168283 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.compute.server_external_events [req-0cc5bb68-1fb3-44a4-9ea1-8590e2ce74a4 req-ac348003-a1e8-4de3-aeb5-ce066abb07e8 service nova] Creating event network-changed:d06501d9-6a97-4277-a1d1-1171ea317203 for instance 9c87b8e9-adf1-40f0-b5d1-6efa2f25ab63 on hv-cinder-81571 May 26 12:48:22.173281 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [req-0cc5bb68-1fb3-44a4-9ea1-8590e2ce74a4 req-ac348003-a1e8-4de3-aeb5-ce066abb07e8 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030633 May 26 12:48:22.173923 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 130/276] 10.222.0.41 () {64 vars in 1317 bytes} [Thu May 26 12:48:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:48:22.230987 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-500de371-3ef2-49cf-8fec-728c09286b2c tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:22.231747 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-500de371-3ef2-49cf-8fec-728c09286b2c tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] [instance: 9c87b8e9-adf1-40f0-b5d1-6efa2f25ab63] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:22.238932 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-500de371-3ef2-49cf-8fec-728c09286b2c tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:22.239381 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-500de371-3ef2-49cf-8fec-728c09286b2c tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:22.240147 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-500de371-3ef2-49cf-8fec-728c09286b2c tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:22.241131 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-500de371-3ef2-49cf-8fec-728c09286b2c tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:22.387715 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-500de371-3ef2-49cf-8fec-728c09286b2c tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646a9abb1f9d4a1295a04defd895ff7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd539dfec943a44eb9b025d842a1f858d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:22.390546 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-500de371-3ef2-49cf-8fec-728c09286b2c tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] 10.222.0.41 "GET /compute/v2.1/servers/9c87b8e9-adf1-40f0-b5d1-6efa2f25ab63" status: 200 len: 1318 microversion: 2.1 time: 0.163420 May 26 12:48:22.391122 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 147/277] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:48:22 2022] GET /compute/v2.1/servers/9c87b8e9-adf1-40f0-b5d1-6efa2f25ab63 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:22.856788 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-2a7ec566-3fe4-4b6c-b36f-fc64df2d64b0 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:22.857489 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-2a7ec566-3fe4-4b6c-b36f-fc64df2d64b0 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 7ffbf048-2aa0-4656-a6cd-923b35031eaa] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:22.863803 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-2a7ec566-3fe4-4b6c-b36f-fc64df2d64b0 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:22.864256 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-2a7ec566-3fe4-4b6c-b36f-fc64df2d64b0 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:22.865018 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-2a7ec566-3fe4-4b6c-b36f-fc64df2d64b0 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:22.865452 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-2a7ec566-3fe4-4b6c-b36f-fc64df2d64b0 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:23.075988 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-2a7ec566-3fe4-4b6c-b36f-fc64df2d64b0 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:23.088414 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-2a7ec566-3fe4-4b6c-b36f-fc64df2d64b0 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:23.090097 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-2a7ec566-3fe4-4b6c-b36f-fc64df2d64b0 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:23.091293 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-2a7ec566-3fe4-4b6c-b36f-fc64df2d64b0 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa" status: 200 len: 1723 microversion: 2.20 time: 0.238864 May 26 12:48:23.091850 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 131/278] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:48:22 2022] GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa => generated 1723 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:48:23.406868 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-9c59209b-de34-4fb3-865c-0edffb15a311 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:23.407478 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-9c59209b-de34-4fb3-865c-0edffb15a311 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] [instance: 9c87b8e9-adf1-40f0-b5d1-6efa2f25ab63] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:23.414833 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-9c59209b-de34-4fb3-865c-0edffb15a311 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:23.415356 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-9c59209b-de34-4fb3-865c-0edffb15a311 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:23.416134 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-9c59209b-de34-4fb3-865c-0edffb15a311 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:23.416568 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-9c59209b-de34-4fb3-865c-0edffb15a311 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:23.494870 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-de741431-efdd-4697-ad1b-a31d945926e0 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1806573037", "imageRef": "6df25342-b071-489b-a7c1-3089fa19af6d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fd8eb981-0241-4288-8206-05bf49eea8ea"}], "security_groups": [{"name": "tempest-securitygroup--1182254267"}], "key_name": "tempest-keypair-399683608", "user_data": "}} {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:48:23.581776 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-9c59209b-de34-4fb3-865c-0edffb15a311 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646a9abb1f9d4a1295a04defd895ff7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd539dfec943a44eb9b025d842a1f858d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:23.589231 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-9c59209b-de34-4fb3-865c-0edffb15a311 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] 10.222.0.41 "GET /compute/v2.1/servers/9c87b8e9-adf1-40f0-b5d1-6efa2f25ab63" status: 200 len: 1318 microversion: 2.1 time: 0.186205 May 26 12:48:23.589930 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 148/279] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:48:23 2022] GET /compute/v2.1/servers/9c87b8e9-adf1-40f0-b5d1-6efa2f25ab63 => generated 1318 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:23.605082 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.network.neutron [None req-de741431-efdd-4697-ad1b-a31d945926e0 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] validate_networks() for [('fd8eb981-0241-4288-8206-05bf49eea8ea', None, None, None, None, None)] {{(pid=124824) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 12:48:23.710378 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-a73820ce-6400-422a-8188-91dba08ba25d tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-163007140", "imageRef": "6df25342-b071-489b-a7c1-3089fa19af6d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a5fd1140-8cda-4630-8a6d-7a85bf14faa2"}], "security_groups": [{"name": "tempest-securitygroup--600944694"}], "key_name": "tempest-keypair-1042284356", "user_data": "}} {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:48:23.874435 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.network.neutron [None req-a73820ce-6400-422a-8188-91dba08ba25d tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] validate_networks() for [('a5fd1140-8cda-4630-8a6d-7a85bf14faa2', None, None, None, None, None)] {{(pid=124823) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 12:48:23.993327 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.virt.hardware [None req-de741431-efdd-4697-ad1b-a31d945926e0 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Flavor limits 0:0:0 {{(pid=124824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 12:48:23.993883 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.virt.hardware [None req-de741431-efdd-4697-ad1b-a31d945926e0 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Image limits 0:0:0 {{(pid=124824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 12:48:23.994463 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.virt.hardware [None req-de741431-efdd-4697-ad1b-a31d945926e0 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Flavor pref 0:0:0 {{(pid=124824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 12:48:23.994868 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.virt.hardware [None req-de741431-efdd-4697-ad1b-a31d945926e0 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Image pref 0:0:0 {{(pid=124824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 12:48:23.995304 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.virt.hardware [None req-de741431-efdd-4697-ad1b-a31d945926e0 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 12:48:24.004240 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-de741431-efdd-4697-ad1b-a31d945926e0 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:24.004685 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-de741431-efdd-4697-ad1b-a31d945926e0 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:24.005469 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-de741431-efdd-4697-ad1b-a31d945926e0 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:24.005926 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-de741431-efdd-4697-ad1b-a31d945926e0 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:24.023090 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.quota [None req-de741431-efdd-4697-ad1b-a31d945926e0 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Getting quotas for project cad768b45d17480d8d6bbbcff6032c8d. Resources: {'instances', 'ram', 'cores'} {{(pid=124824) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:48:24.027385 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.quota [None req-de741431-efdd-4697-ad1b-a31d945926e0 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Getting quotas for user 0537911b91184fcdbdcc9e93ec3fe5b9 and project cad768b45d17480d8d6bbbcff6032c8d. Resources: {'instances', 'ram', 'cores'} {{(pid=124824) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:48:24.039280 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-de741431-efdd-4697-ad1b-a31d945926e0 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Going to run 1 instances... {{(pid=124824) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 12:48:24.041548 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-de741431-efdd-4697-ad1b-a31d945926e0 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: d6056156-21c7-47e2-9303-f90a8ec1b474] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6df25342-b071-489b-a7c1-3089fa19af6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124824) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 12:48:24.337200 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-de741431-efdd-4697-ad1b-a31d945926e0 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.846676 May 26 12:48:24.338428 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 132/280] 10.222.0.41 () {60 vars in 1146 bytes} [Thu May 26 12:48:23 2022] POST /compute/v2.1/servers => generated 402 bytes in 849 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 26 12:48:24.343714 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-81fb306c-5110-4fb2-bada-da227e241aa8 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:24.344323 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-81fb306c-5110-4fb2-bada-da227e241aa8 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 7ffbf048-2aa0-4656-a6cd-923b35031eaa] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:24.351380 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-81fb306c-5110-4fb2-bada-da227e241aa8 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:24.351827 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-81fb306c-5110-4fb2-bada-da227e241aa8 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:24.352593 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-81fb306c-5110-4fb2-bada-da227e241aa8 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:24.353021 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-81fb306c-5110-4fb2-bada-da227e241aa8 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:24.511415 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-81fb306c-5110-4fb2-bada-da227e241aa8 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:24.520983 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-81fb306c-5110-4fb2-bada-da227e241aa8 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:24.522756 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-81fb306c-5110-4fb2-bada-da227e241aa8 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:24.523931 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-81fb306c-5110-4fb2-bada-da227e241aa8 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa" status: 200 len: 1744 microversion: 2.20 time: 0.184119 May 26 12:48:24.524497 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 133/281] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:48:24 2022] GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa => generated 1744 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:48:24.530203 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-57bd4f1d-e426-4a68-b73f-ad88d160469b tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:24.530814 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-57bd4f1d-e426-4a68-b73f-ad88d160469b tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: d6056156-21c7-47e2-9303-f90a8ec1b474] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:24.583565 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-57bd4f1d-e426-4a68-b73f-ad88d160469b tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0537911b91184fcdbdcc9e93ec3fe5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad768b45d17480d8d6bbbcff6032c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:24.590301 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-57bd4f1d-e426-4a68-b73f-ad88d160469b tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "GET /compute/v2.1/servers/d6056156-21c7-47e2-9303-f90a8ec1b474" status: 200 len: 1241 microversion: 2.1 time: 0.064867 May 26 12:48:24.590882 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 134/282] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:48:24 2022] GET /compute/v2.1/servers/d6056156-21c7-47e2-9303-f90a8ec1b474 => generated 1241 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:24.606871 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-29826401-114a-4ea1-b3c9-d4d99f93d731 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:24.607471 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-29826401-114a-4ea1-b3c9-d4d99f93d731 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] [instance: 9c87b8e9-adf1-40f0-b5d1-6efa2f25ab63] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:24.613839 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-29826401-114a-4ea1-b3c9-d4d99f93d731 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:24.624652 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-29826401-114a-4ea1-b3c9-d4d99f93d731 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:24.624652 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-29826401-114a-4ea1-b3c9-d4d99f93d731 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:24.624652 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-29826401-114a-4ea1-b3c9-d4d99f93d731 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:24.624652 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG dbcounter [-] [124824] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:24.710192 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.virt.hardware [None req-a73820ce-6400-422a-8188-91dba08ba25d tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Flavor limits 0:0:0 {{(pid=124823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 12:48:24.710796 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.virt.hardware [None req-a73820ce-6400-422a-8188-91dba08ba25d tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Image limits 0:0:0 {{(pid=124823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 12:48:24.717333 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.virt.hardware [None req-a73820ce-6400-422a-8188-91dba08ba25d tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Flavor pref 0:0:0 {{(pid=124823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 12:48:24.717333 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.virt.hardware [None req-a73820ce-6400-422a-8188-91dba08ba25d tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Image pref 0:0:0 {{(pid=124823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 12:48:24.717333 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.virt.hardware [None req-a73820ce-6400-422a-8188-91dba08ba25d tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 12:48:24.745808 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-a73820ce-6400-422a-8188-91dba08ba25d tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:24.745808 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-a73820ce-6400-422a-8188-91dba08ba25d tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:24.745808 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-a73820ce-6400-422a-8188-91dba08ba25d tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:24.745808 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-a73820ce-6400-422a-8188-91dba08ba25d tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:24.752620 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-29826401-114a-4ea1-b3c9-d4d99f93d731 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646a9abb1f9d4a1295a04defd895ff7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd539dfec943a44eb9b025d842a1f858d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:24.760545 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-29826401-114a-4ea1-b3c9-d4d99f93d731 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] 10.222.0.41 "GET /compute/v2.1/servers/9c87b8e9-adf1-40f0-b5d1-6efa2f25ab63" status: 200 len: 1318 microversion: 2.1 time: 0.157424 May 26 12:48:24.762038 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 135/283] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:48:24 2022] GET /compute/v2.1/servers/9c87b8e9-adf1-40f0-b5d1-6efa2f25ab63 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:24.784836 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.quota [None req-a73820ce-6400-422a-8188-91dba08ba25d tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Getting quotas for project 9930a0f4448d4ef0a6030da17a36257a. Resources: {'instances', 'ram', 'cores'} {{(pid=124823) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:48:24.790823 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.quota [None req-a73820ce-6400-422a-8188-91dba08ba25d tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Getting quotas for user cf98a4d33cab49b08640f437dbfb2dc8 and project 9930a0f4448d4ef0a6030da17a36257a. Resources: {'instances', 'ram', 'cores'} {{(pid=124823) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:48:24.804089 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-a73820ce-6400-422a-8188-91dba08ba25d tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Going to run 1 instances... {{(pid=124823) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 12:48:24.806852 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-a73820ce-6400-422a-8188-91dba08ba25d tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: 7aa85144-0ebe-430c-b9e5-9b656ea4560a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6df25342-b071-489b-a7c1-3089fa19af6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124823) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 12:48:24.942895 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-a73820ce-6400-422a-8188-91dba08ba25d tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.236721 May 26 12:48:24.944514 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 149/284] 10.222.0.41 () {60 vars in 1146 bytes} [Thu May 26 12:48:23 2022] POST /compute/v2.1/servers => generated 408 bytes in 1238 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 26 12:48:24.953426 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-92eae6e2-0b2a-4e6b-9354-afc769411467 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:24.954058 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-92eae6e2-0b2a-4e6b-9354-afc769411467 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: 7aa85144-0ebe-430c-b9e5-9b656ea4560a] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:25.026091 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-92eae6e2-0b2a-4e6b-9354-afc769411467 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:25.040223 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-92eae6e2-0b2a-4e6b-9354-afc769411467 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a" status: 200 len: 1245 microversion: 2.1 time: 0.090537 May 26 12:48:25.040865 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 136/285] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:48:24 2022] GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a => generated 1245 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:25.544562 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-d2b6189f-b347-4ca1-b297-6d6a7d70f993 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:25.545205 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-d2b6189f-b347-4ca1-b297-6d6a7d70f993 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 7ffbf048-2aa0-4656-a6cd-923b35031eaa] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:25.552062 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-d2b6189f-b347-4ca1-b297-6d6a7d70f993 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:25.552551 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-d2b6189f-b347-4ca1-b297-6d6a7d70f993 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:25.553312 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-d2b6189f-b347-4ca1-b297-6d6a7d70f993 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:25.553770 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-d2b6189f-b347-4ca1-b297-6d6a7d70f993 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:25.565153 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG dbcounter [-] [124823] Writing DB stats nova_cell1:SELECT=100 {{(pid=124823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:25.609092 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-3e615521-108c-48bd-9746-e4ec7b87d651 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:25.609880 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-3e615521-108c-48bd-9746-e4ec7b87d651 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: d6056156-21c7-47e2-9303-f90a8ec1b474] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:25.617641 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-3e615521-108c-48bd-9746-e4ec7b87d651 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:25.618246 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-3e615521-108c-48bd-9746-e4ec7b87d651 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:25.619220 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-3e615521-108c-48bd-9746-e4ec7b87d651 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:25.619851 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-3e615521-108c-48bd-9746-e4ec7b87d651 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:25.683658 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-3e615521-108c-48bd-9746-e4ec7b87d651 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0537911b91184fcdbdcc9e93ec3fe5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad768b45d17480d8d6bbbcff6032c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:25.691719 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-d2b6189f-b347-4ca1-b297-6d6a7d70f993 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:25.692146 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-3e615521-108c-48bd-9746-e4ec7b87d651 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "GET /compute/v2.1/servers/d6056156-21c7-47e2-9303-f90a8ec1b474" status: 200 len: 1245 microversion: 2.1 time: 0.087597 May 26 12:48:25.692936 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 137/286] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:48:25 2022] GET /compute/v2.1/servers/d6056156-21c7-47e2-9303-f90a8ec1b474 => generated 1245 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:48:25.702451 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-d2b6189f-b347-4ca1-b297-6d6a7d70f993 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:25.702600 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-d2b6189f-b347-4ca1-b297-6d6a7d70f993 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:25.703677 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-d2b6189f-b347-4ca1-b297-6d6a7d70f993 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa" status: 200 len: 1744 microversion: 2.20 time: 0.164463 May 26 12:48:25.704581 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 150/287] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:48:25 2022] GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa => generated 1744 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:48:25.778292 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-94c403c6-2455-4485-ab98-6aa36bafb256 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:25.779112 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-94c403c6-2455-4485-ab98-6aa36bafb256 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] [instance: 9c87b8e9-adf1-40f0-b5d1-6efa2f25ab63] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:25.785744 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-94c403c6-2455-4485-ab98-6aa36bafb256 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:25.786203 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-94c403c6-2455-4485-ab98-6aa36bafb256 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:25.787007 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-94c403c6-2455-4485-ab98-6aa36bafb256 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:25.787502 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-94c403c6-2455-4485-ab98-6aa36bafb256 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:25.926006 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-94c403c6-2455-4485-ab98-6aa36bafb256 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646a9abb1f9d4a1295a04defd895ff7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd539dfec943a44eb9b025d842a1f858d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:25.934790 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-94c403c6-2455-4485-ab98-6aa36bafb256 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] 10.222.0.41 "GET /compute/v2.1/servers/9c87b8e9-adf1-40f0-b5d1-6efa2f25ab63" status: 200 len: 1318 microversion: 2.1 time: 0.160292 May 26 12:48:25.935531 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 138/288] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:48:25 2022] GET /compute/v2.1/servers/9c87b8e9-adf1-40f0-b5d1-6efa2f25ab63 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:26.059683 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-b32dfff6-360a-49d2-a69b-dd54ed53af52 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:26.060402 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-b32dfff6-360a-49d2-a69b-dd54ed53af52 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: 7aa85144-0ebe-430c-b9e5-9b656ea4560a] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:26.066605 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-b32dfff6-360a-49d2-a69b-dd54ed53af52 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:26.067057 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-b32dfff6-360a-49d2-a69b-dd54ed53af52 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:26.067821 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-b32dfff6-360a-49d2-a69b-dd54ed53af52 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:26.068254 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-b32dfff6-360a-49d2-a69b-dd54ed53af52 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:26.144137 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-b32dfff6-360a-49d2-a69b-dd54ed53af52 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:26.152405 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-b32dfff6-360a-49d2-a69b-dd54ed53af52 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a" status: 200 len: 1249 microversion: 2.1 time: 0.096658 May 26 12:48:26.152982 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 151/289] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:48:26 2022] GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a => generated 1249 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:26.710804 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-43ebf1b9-4c59-41e3-84b9-7bdebdab17a6 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:26.711417 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-43ebf1b9-4c59-41e3-84b9-7bdebdab17a6 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: d6056156-21c7-47e2-9303-f90a8ec1b474] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:26.718186 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-43ebf1b9-4c59-41e3-84b9-7bdebdab17a6 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:26.718631 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-43ebf1b9-4c59-41e3-84b9-7bdebdab17a6 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:26.719395 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-43ebf1b9-4c59-41e3-84b9-7bdebdab17a6 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:26.719831 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-43ebf1b9-4c59-41e3-84b9-7bdebdab17a6 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:26.722258 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-62db37ad-8e33-412d-a2cb-50af60408998 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:26.722872 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-62db37ad-8e33-412d-a2cb-50af60408998 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 7ffbf048-2aa0-4656-a6cd-923b35031eaa] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:26.730251 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-62db37ad-8e33-412d-a2cb-50af60408998 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:26.730699 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-62db37ad-8e33-412d-a2cb-50af60408998 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:26.731468 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-62db37ad-8e33-412d-a2cb-50af60408998 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:26.731904 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-62db37ad-8e33-412d-a2cb-50af60408998 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:26.784396 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-43ebf1b9-4c59-41e3-84b9-7bdebdab17a6 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0537911b91184fcdbdcc9e93ec3fe5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad768b45d17480d8d6bbbcff6032c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:26.792713 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-43ebf1b9-4c59-41e3-84b9-7bdebdab17a6 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "GET /compute/v2.1/servers/d6056156-21c7-47e2-9303-f90a8ec1b474" status: 200 len: 1293 microversion: 2.1 time: 0.086468 May 26 12:48:26.797549 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 139/290] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:48:26 2022] GET /compute/v2.1/servers/d6056156-21c7-47e2-9303-f90a8ec1b474 => generated 1293 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:26.861391 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-62db37ad-8e33-412d-a2cb-50af60408998 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:26.870062 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-62db37ad-8e33-412d-a2cb-50af60408998 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:26.871593 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-62db37ad-8e33-412d-a2cb-50af60408998 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:26.872740 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-62db37ad-8e33-412d-a2cb-50af60408998 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa" status: 200 len: 1744 microversion: 2.20 time: 0.154397 May 26 12:48:26.873305 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 152/291] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:48:26 2022] GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa => generated 1744 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:48:26.952315 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-911e26f8-c550-4ab4-ac36-ea1cf8b792e9 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:26.952848 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-911e26f8-c550-4ab4-ac36-ea1cf8b792e9 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] [instance: 9c87b8e9-adf1-40f0-b5d1-6efa2f25ab63] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:26.958904 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-911e26f8-c550-4ab4-ac36-ea1cf8b792e9 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:26.959384 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-911e26f8-c550-4ab4-ac36-ea1cf8b792e9 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:26.960135 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-911e26f8-c550-4ab4-ac36-ea1cf8b792e9 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:26.960564 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-911e26f8-c550-4ab4-ac36-ea1cf8b792e9 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:27.103294 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-911e26f8-c550-4ab4-ac36-ea1cf8b792e9 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646a9abb1f9d4a1295a04defd895ff7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd539dfec943a44eb9b025d842a1f858d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:27.111111 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-911e26f8-c550-4ab4-ac36-ea1cf8b792e9 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] 10.222.0.41 "GET /compute/v2.1/servers/9c87b8e9-adf1-40f0-b5d1-6efa2f25ab63" status: 200 len: 1318 microversion: 2.1 time: 0.162669 May 26 12:48:27.111710 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 140/292] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:48:26 2022] GET /compute/v2.1/servers/9c87b8e9-adf1-40f0-b5d1-6efa2f25ab63 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:27.169591 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-95b62362-03a8-476a-82d6-3c3733196c3c tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:27.170366 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-95b62362-03a8-476a-82d6-3c3733196c3c tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: 7aa85144-0ebe-430c-b9e5-9b656ea4560a] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:27.176686 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-95b62362-03a8-476a-82d6-3c3733196c3c tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:27.177130 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-95b62362-03a8-476a-82d6-3c3733196c3c tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:27.177945 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-95b62362-03a8-476a-82d6-3c3733196c3c tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:27.178380 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-95b62362-03a8-476a-82d6-3c3733196c3c tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:27.240357 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-95b62362-03a8-476a-82d6-3c3733196c3c tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:27.247918 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-95b62362-03a8-476a-82d6-3c3733196c3c tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a" status: 200 len: 1297 microversion: 2.1 time: 0.082171 May 26 12:48:27.248524 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 153/293] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:48:27 2022] GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a => generated 1297 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:27.809490 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-d320ffb9-8849-4762-ac98-251f3009c405 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:27.810742 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-d320ffb9-8849-4762-ac98-251f3009c405 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: d6056156-21c7-47e2-9303-f90a8ec1b474] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:27.831454 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-d320ffb9-8849-4762-ac98-251f3009c405 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:27.832167 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-d320ffb9-8849-4762-ac98-251f3009c405 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:27.833155 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-d320ffb9-8849-4762-ac98-251f3009c405 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:27.833784 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-d320ffb9-8849-4762-ac98-251f3009c405 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:27.891852 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-c791b274-110d-4f8a-bcdf-204a4ddf1b53 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:27.900338 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-c791b274-110d-4f8a-bcdf-204a4ddf1b53 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 7ffbf048-2aa0-4656-a6cd-923b35031eaa] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:27.900338 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-c791b274-110d-4f8a-bcdf-204a4ddf1b53 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:27.901138 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-c791b274-110d-4f8a-bcdf-204a4ddf1b53 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:27.902140 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-c791b274-110d-4f8a-bcdf-204a4ddf1b53 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:27.902911 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-c791b274-110d-4f8a-bcdf-204a4ddf1b53 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:27.943748 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-d320ffb9-8849-4762-ac98-251f3009c405 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0537911b91184fcdbdcc9e93ec3fe5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad768b45d17480d8d6bbbcff6032c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:27.955185 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-d320ffb9-8849-4762-ac98-251f3009c405 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "GET /compute/v2.1/servers/d6056156-21c7-47e2-9303-f90a8ec1b474" status: 200 len: 1301 microversion: 2.1 time: 0.149269 May 26 12:48:27.961262 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 141/294] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:48:27 2022] GET /compute/v2.1/servers/d6056156-21c7-47e2-9303-f90a8ec1b474 => generated 1301 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:27.981813 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [req-15bd81b9-fc67-40d3-b271-3bfeb2947b6d req-4642c855-1a8c-44df-a27f-f065d9a0d85c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ffbf048-2aa0-4656-a6cd-923b35031eaa", "name": "network-vif-plugged", "status": "completed", "tag": "979ef417-a463-49c2-a7ae-7fae04d77dd9"}]} {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:48:27.992981 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [req-15bd81b9-fc67-40d3-b271-3bfeb2947b6d req-4642c855-1a8c-44df-a27f-f065d9a0d85c service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:27.993503 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [req-15bd81b9-fc67-40d3-b271-3bfeb2947b6d req-4642c855-1a8c-44df-a27f-f065d9a0d85c service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:28.037102 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.compute.server_external_events [req-15bd81b9-fc67-40d3-b271-3bfeb2947b6d req-4642c855-1a8c-44df-a27f-f065d9a0d85c service nova] Creating event network-vif-plugged:979ef417-a463-49c2-a7ae-7fae04d77dd9 for instance 7ffbf048-2aa0-4656-a6cd-923b35031eaa on hv-cinder-81571 May 26 12:48:28.053294 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [req-15bd81b9-fc67-40d3-b271-3bfeb2947b6d req-4642c855-1a8c-44df-a27f-f065d9a0d85c service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077354 May 26 12:48:28.053294 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 142/295] 10.222.0.41 () {64 vars in 1317 bytes} [Thu May 26 12:48:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:48:28.136686 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-f49c7fd9-0819-4051-80bb-33900a59efd2 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:28.136686 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-f49c7fd9-0819-4051-80bb-33900a59efd2 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] [instance: 9c87b8e9-adf1-40f0-b5d1-6efa2f25ab63] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:28.144137 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG dbcounter [-] [124824] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=124824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:28.150261 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-f49c7fd9-0819-4051-80bb-33900a59efd2 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:28.150793 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-f49c7fd9-0819-4051-80bb-33900a59efd2 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:28.153129 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-f49c7fd9-0819-4051-80bb-33900a59efd2 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:28.154552 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-f49c7fd9-0819-4051-80bb-33900a59efd2 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:28.279981 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-c791b274-110d-4f8a-bcdf-204a4ddf1b53 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:28.297315 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-c791b274-110d-4f8a-bcdf-204a4ddf1b53 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:28.315179 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-c791b274-110d-4f8a-bcdf-204a4ddf1b53 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:28.317114 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-c791b274-110d-4f8a-bcdf-204a4ddf1b53 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa" status: 200 len: 1739 microversion: 2.20 time: 0.430513 May 26 12:48:28.331189 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 154/296] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:48:27 2022] GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa => generated 1739 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:48:28.337801 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-407af90d-4c59-4ec0-8453-050f9adfff24 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:28.338894 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-407af90d-4c59-4ec0-8453-050f9adfff24 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: 7aa85144-0ebe-430c-b9e5-9b656ea4560a] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:28.346356 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-407af90d-4c59-4ec0-8453-050f9adfff24 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:28.347063 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-407af90d-4c59-4ec0-8453-050f9adfff24 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:28.347957 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-407af90d-4c59-4ec0-8453-050f9adfff24 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:28.349201 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-407af90d-4c59-4ec0-8453-050f9adfff24 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:28.472867 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-407af90d-4c59-4ec0-8453-050f9adfff24 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:28.489538 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-407af90d-4c59-4ec0-8453-050f9adfff24 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a" status: 200 len: 1303 microversion: 2.1 time: 0.157052 May 26 12:48:28.492115 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 155/297] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:48:28 2022] GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a => generated 1303 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:28.585522 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-f49c7fd9-0819-4051-80bb-33900a59efd2 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646a9abb1f9d4a1295a04defd895ff7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd539dfec943a44eb9b025d842a1f858d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:28.593924 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-f49c7fd9-0819-4051-80bb-33900a59efd2 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] 10.222.0.41 "GET /compute/v2.1/servers/9c87b8e9-adf1-40f0-b5d1-6efa2f25ab63" status: 200 len: 1318 microversion: 2.1 time: 0.466939 May 26 12:48:28.607725 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 143/298] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:48:28 2022] GET /compute/v2.1/servers/9c87b8e9-adf1-40f0-b5d1-6efa2f25ab63 => generated 1318 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:28.975286 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-29489be3-9666-46f8-bb83-71e9ef009817 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:28.975909 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-29489be3-9666-46f8-bb83-71e9ef009817 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: d6056156-21c7-47e2-9303-f90a8ec1b474] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:28.989114 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-29489be3-9666-46f8-bb83-71e9ef009817 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:28.989568 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-29489be3-9666-46f8-bb83-71e9ef009817 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:28.990437 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-29489be3-9666-46f8-bb83-71e9ef009817 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:28.991374 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-29489be3-9666-46f8-bb83-71e9ef009817 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:29.338423 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-84b74aad-b81a-4b9d-a233-dfba6bfd9e50 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:29.339615 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-84b74aad-b81a-4b9d-a233-dfba6bfd9e50 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 7ffbf048-2aa0-4656-a6cd-923b35031eaa] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:29.349649 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-84b74aad-b81a-4b9d-a233-dfba6bfd9e50 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:29.358094 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-84b74aad-b81a-4b9d-a233-dfba6bfd9e50 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:29.359770 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-84b74aad-b81a-4b9d-a233-dfba6bfd9e50 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:29.360361 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-84b74aad-b81a-4b9d-a233-dfba6bfd9e50 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:29.530140 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-29489be3-9666-46f8-bb83-71e9ef009817 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0537911b91184fcdbdcc9e93ec3fe5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad768b45d17480d8d6bbbcff6032c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:29.551873 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-29489be3-9666-46f8-bb83-71e9ef009817 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "GET /compute/v2.1/servers/d6056156-21c7-47e2-9303-f90a8ec1b474" status: 200 len: 1367 microversion: 2.1 time: 0.583113 May 26 12:48:29.563334 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 156/299] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:48:28 2022] GET /compute/v2.1/servers/d6056156-21c7-47e2-9303-f90a8ec1b474 => generated 1367 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:29.572652 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-9c6a5aba-ec6f-438a-9f1f-0a8c813027fe tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:29.573266 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-9c6a5aba-ec6f-438a-9f1f-0a8c813027fe tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: 7aa85144-0ebe-430c-b9e5-9b656ea4560a] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:29.589069 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-9c6a5aba-ec6f-438a-9f1f-0a8c813027fe tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:29.589822 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-9c6a5aba-ec6f-438a-9f1f-0a8c813027fe tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:29.590798 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-9c6a5aba-ec6f-438a-9f1f-0a8c813027fe tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:29.593077 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-9c6a5aba-ec6f-438a-9f1f-0a8c813027fe tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:29.661885 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-84b74aad-b81a-4b9d-a233-dfba6bfd9e50 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:29.675572 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-84b74aad-b81a-4b9d-a233-dfba6bfd9e50 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:29.684236 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-84b74aad-b81a-4b9d-a233-dfba6bfd9e50 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:29.689276 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-84b74aad-b81a-4b9d-a233-dfba6bfd9e50 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa" status: 200 len: 1739 microversion: 2.20 time: 0.353855 May 26 12:48:29.702636 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 144/300] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:48:29 2022] GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa => generated 1739 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:48:29.712981 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-9cfd9ed5-836b-455b-ad8c-531f6378a453 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:29.714443 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-9cfd9ed5-836b-455b-ad8c-531f6378a453 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] [instance: 9c87b8e9-adf1-40f0-b5d1-6efa2f25ab63] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:29.722547 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-9cfd9ed5-836b-455b-ad8c-531f6378a453 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:29.723090 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-9cfd9ed5-836b-455b-ad8c-531f6378a453 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:29.724238 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-9cfd9ed5-836b-455b-ad8c-531f6378a453 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:29.725658 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-9cfd9ed5-836b-455b-ad8c-531f6378a453 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:30.191470 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-9cfd9ed5-836b-455b-ad8c-531f6378a453 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646a9abb1f9d4a1295a04defd895ff7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd539dfec943a44eb9b025d842a1f858d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:30.209979 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-9cfd9ed5-836b-455b-ad8c-531f6378a453 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] 10.222.0.41 "GET /compute/v2.1/servers/9c87b8e9-adf1-40f0-b5d1-6efa2f25ab63" status: 200 len: 1318 microversion: 2.1 time: 0.508846 May 26 12:48:30.211880 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 145/301] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:48:29 2022] GET /compute/v2.1/servers/9c87b8e9-adf1-40f0-b5d1-6efa2f25ab63 => generated 1318 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:30.235921 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [req-96725ff3-881d-410b-9447-94089d8e50ec req-115a0078-3b52-4f43-897c-39538ecdfb8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c87b8e9-adf1-40f0-b5d1-6efa2f25ab63", "name": "network-vif-plugged", "status": "completed", "tag": "d06501d9-6a97-4277-a1d1-1171ea317203"}]} {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:48:30.252341 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [req-96725ff3-881d-410b-9447-94089d8e50ec req-115a0078-3b52-4f43-897c-39538ecdfb8d service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:30.255990 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [req-96725ff3-881d-410b-9447-94089d8e50ec req-115a0078-3b52-4f43-897c-39538ecdfb8d service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:30.285427 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.compute.server_external_events [req-96725ff3-881d-410b-9447-94089d8e50ec req-115a0078-3b52-4f43-897c-39538ecdfb8d service nova] Creating event network-vif-plugged:d06501d9-6a97-4277-a1d1-1171ea317203 for instance 9c87b8e9-adf1-40f0-b5d1-6efa2f25ab63 on hv-cinder-81571 May 26 12:48:30.303397 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [req-96725ff3-881d-410b-9447-94089d8e50ec req-115a0078-3b52-4f43-897c-39538ecdfb8d service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066028 May 26 12:48:30.307960 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 146/302] 10.222.0.41 () {64 vars in 1317 bytes} [Thu May 26 12:48:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:48:30.355230 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-9c6a5aba-ec6f-438a-9f1f-0a8c813027fe tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:30.369217 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-9c6a5aba-ec6f-438a-9f1f-0a8c813027fe tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a" status: 200 len: 1370 microversion: 2.1 time: 0.803819 May 26 12:48:30.370094 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 157/303] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:48:29 2022] GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a => generated 1370 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:30.577147 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-0a863b4f-24be-48e7-839a-d97a5171c8f0 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:30.585885 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-0a863b4f-24be-48e7-839a-d97a5171c8f0 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: d6056156-21c7-47e2-9303-f90a8ec1b474] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:30.602664 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-0a863b4f-24be-48e7-839a-d97a5171c8f0 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:30.606262 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-0a863b4f-24be-48e7-839a-d97a5171c8f0 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:30.627809 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-0a863b4f-24be-48e7-839a-d97a5171c8f0 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:30.628343 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-0a863b4f-24be-48e7-839a-d97a5171c8f0 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:30.709312 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-dc7c1f87-c85f-4cbc-9687-97ff94eb6385 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:30.710069 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-dc7c1f87-c85f-4cbc-9687-97ff94eb6385 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 7ffbf048-2aa0-4656-a6cd-923b35031eaa] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:30.717134 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-dc7c1f87-c85f-4cbc-9687-97ff94eb6385 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:30.719703 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-dc7c1f87-c85f-4cbc-9687-97ff94eb6385 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:30.721908 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-dc7c1f87-c85f-4cbc-9687-97ff94eb6385 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:30.722799 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-dc7c1f87-c85f-4cbc-9687-97ff94eb6385 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:31.115911 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-0a863b4f-24be-48e7-839a-d97a5171c8f0 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0537911b91184fcdbdcc9e93ec3fe5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad768b45d17480d8d6bbbcff6032c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:31.125487 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-0a863b4f-24be-48e7-839a-d97a5171c8f0 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "GET /compute/v2.1/servers/d6056156-21c7-47e2-9303-f90a8ec1b474" status: 200 len: 1367 microversion: 2.1 time: 0.558147 May 26 12:48:31.127953 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 147/304] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:48:30 2022] GET /compute/v2.1/servers/d6056156-21c7-47e2-9303-f90a8ec1b474 => generated 1367 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:31.143734 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [req-55de4076-e7d2-429f-86d5-c116e65e37e1 req-a3314cd7-fb14-47a4-98a9-07f0bd28d11b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7aa85144-0ebe-430c-b9e5-9b656ea4560a", "tag": "e5a6930c-e135-4546-bcdc-823bfe4c6e87"}]} {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:48:31.144965 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-dc7c1f87-c85f-4cbc-9687-97ff94eb6385 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:31.151870 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [req-55de4076-e7d2-429f-86d5-c116e65e37e1 req-a3314cd7-fb14-47a4-98a9-07f0bd28d11b service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:31.162475 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [req-55de4076-e7d2-429f-86d5-c116e65e37e1 req-a3314cd7-fb14-47a4-98a9-07f0bd28d11b service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:31.168981 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-dc7c1f87-c85f-4cbc-9687-97ff94eb6385 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:31.171391 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-dc7c1f87-c85f-4cbc-9687-97ff94eb6385 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:31.180957 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-dc7c1f87-c85f-4cbc-9687-97ff94eb6385 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa" status: 200 len: 1739 microversion: 2.20 time: 0.474836 May 26 12:48:31.186621 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 158/305] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:48:30 2022] GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa => generated 1739 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:48:31.195885 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.compute.server_external_events [req-55de4076-e7d2-429f-86d5-c116e65e37e1 req-a3314cd7-fb14-47a4-98a9-07f0bd28d11b service nova] Creating event network-changed:e5a6930c-e135-4546-bcdc-823bfe4c6e87 for instance 7aa85144-0ebe-430c-b9e5-9b656ea4560a on hv-cinder-81571 May 26 12:48:31.207507 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [req-55de4076-e7d2-429f-86d5-c116e65e37e1 req-a3314cd7-fb14-47a4-98a9-07f0bd28d11b service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071322 May 26 12:48:31.208125 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 148/306] 10.222.0.41 () {64 vars in 1317 bytes} [Thu May 26 12:48:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:48:31.230636 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-48aa4161-ae9b-419f-8862-7f067f9912b0 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:31.231250 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-48aa4161-ae9b-419f-8862-7f067f9912b0 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] [instance: 9c87b8e9-adf1-40f0-b5d1-6efa2f25ab63] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:31.245991 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-48aa4161-ae9b-419f-8862-7f067f9912b0 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:31.246447 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-48aa4161-ae9b-419f-8862-7f067f9912b0 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:31.247237 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-48aa4161-ae9b-419f-8862-7f067f9912b0 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:31.247706 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-48aa4161-ae9b-419f-8862-7f067f9912b0 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:31.390317 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-9c9b7c7e-ee6b-42e6-af29-8190fe355dcf tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:31.400398 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-9c9b7c7e-ee6b-42e6-af29-8190fe355dcf tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: 7aa85144-0ebe-430c-b9e5-9b656ea4560a] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:31.410978 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-48aa4161-ae9b-419f-8862-7f067f9912b0 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646a9abb1f9d4a1295a04defd895ff7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd539dfec943a44eb9b025d842a1f858d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:31.413313 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-9c9b7c7e-ee6b-42e6-af29-8190fe355dcf tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:31.413795 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-9c9b7c7e-ee6b-42e6-af29-8190fe355dcf tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:31.414579 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-9c9b7c7e-ee6b-42e6-af29-8190fe355dcf tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:31.419142 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-9c9b7c7e-ee6b-42e6-af29-8190fe355dcf tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:31.422497 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-48aa4161-ae9b-419f-8862-7f067f9912b0 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] 10.222.0.41 "GET /compute/v2.1/servers/9c87b8e9-adf1-40f0-b5d1-6efa2f25ab63" status: 200 len: 1318 microversion: 2.1 time: 0.195521 May 26 12:48:31.423798 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 159/307] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:48:31 2022] GET /compute/v2.1/servers/9c87b8e9-adf1-40f0-b5d1-6efa2f25ab63 => generated 1318 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:31.571121 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [req-454dcce7-74a1-47bc-9a19-84e5b7b5e2ce req-f7cda714-99f0-4790-a360-339ee073f84a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6056156-21c7-47e2-9303-f90a8ec1b474", "tag": "141703c8-60fb-4601-9241-65a9a0f37d8d"}]} {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:48:31.585169 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [req-454dcce7-74a1-47bc-9a19-84e5b7b5e2ce req-f7cda714-99f0-4790-a360-339ee073f84a service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:31.585985 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [req-454dcce7-74a1-47bc-9a19-84e5b7b5e2ce req-f7cda714-99f0-4790-a360-339ee073f84a service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:31.606381 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.compute.server_external_events [req-454dcce7-74a1-47bc-9a19-84e5b7b5e2ce req-f7cda714-99f0-4790-a360-339ee073f84a service nova] Creating event network-changed:141703c8-60fb-4601-9241-65a9a0f37d8d for instance d6056156-21c7-47e2-9303-f90a8ec1b474 on hv-cinder-81571 May 26 12:48:31.613681 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [req-454dcce7-74a1-47bc-9a19-84e5b7b5e2ce req-f7cda714-99f0-4790-a360-339ee073f84a service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047628 May 26 12:48:31.614826 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 160/308] 10.222.0.41 () {64 vars in 1317 bytes} [Thu May 26 12:48:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:48:31.727453 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-9c9b7c7e-ee6b-42e6-af29-8190fe355dcf tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:31.739708 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-9c9b7c7e-ee6b-42e6-af29-8190fe355dcf tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a" status: 200 len: 1370 microversion: 2.1 time: 0.352776 May 26 12:48:31.749412 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 149/309] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:48:31 2022] GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a => generated 1370 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:48:32.144740 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-5323f71a-97fd-4193-9a07-dc0f1cf89757 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:32.232265 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-5323f71a-97fd-4193-9a07-dc0f1cf89757 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: d6056156-21c7-47e2-9303-f90a8ec1b474] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:32.232265 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-5323f71a-97fd-4193-9a07-dc0f1cf89757 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:32.232265 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-5323f71a-97fd-4193-9a07-dc0f1cf89757 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:32.232265 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-5323f71a-97fd-4193-9a07-dc0f1cf89757 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:32.232635 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-5323f71a-97fd-4193-9a07-dc0f1cf89757 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:32.232708 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-424d7538-3809-4588-87ef-197dbd0de4ea tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:32.232708 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-424d7538-3809-4588-87ef-197dbd0de4ea tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 7ffbf048-2aa0-4656-a6cd-923b35031eaa] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:32.232708 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-424d7538-3809-4588-87ef-197dbd0de4ea tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:32.232708 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-424d7538-3809-4588-87ef-197dbd0de4ea tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:32.233002 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-424d7538-3809-4588-87ef-197dbd0de4ea tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:32.233002 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-424d7538-3809-4588-87ef-197dbd0de4ea tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:32.561507 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-5323f71a-97fd-4193-9a07-dc0f1cf89757 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0537911b91184fcdbdcc9e93ec3fe5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad768b45d17480d8d6bbbcff6032c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:32.572235 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-5323f71a-97fd-4193-9a07-dc0f1cf89757 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "GET /compute/v2.1/servers/d6056156-21c7-47e2-9303-f90a8ec1b474" status: 200 len: 1367 microversion: 2.1 time: 0.431795 May 26 12:48:32.583167 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 161/310] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:48:32 2022] GET /compute/v2.1/servers/d6056156-21c7-47e2-9303-f90a8ec1b474 => generated 1367 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:32.591047 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-a03134bb-4683-47fc-9d9f-9f69d752df5d tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:32.591930 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-a03134bb-4683-47fc-9d9f-9f69d752df5d tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] [instance: 9c87b8e9-adf1-40f0-b5d1-6efa2f25ab63] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:32.601985 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-a03134bb-4683-47fc-9d9f-9f69d752df5d tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:32.603708 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-a03134bb-4683-47fc-9d9f-9f69d752df5d tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:32.604700 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-a03134bb-4683-47fc-9d9f-9f69d752df5d tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:32.605330 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-a03134bb-4683-47fc-9d9f-9f69d752df5d tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:32.759710 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-a03134bb-4683-47fc-9d9f-9f69d752df5d tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646a9abb1f9d4a1295a04defd895ff7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd539dfec943a44eb9b025d842a1f858d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:32.761029 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-424d7538-3809-4588-87ef-197dbd0de4ea tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:32.767470 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-a03134bb-4683-47fc-9d9f-9f69d752df5d tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] 10.222.0.41 "GET /compute/v2.1/servers/9c87b8e9-adf1-40f0-b5d1-6efa2f25ab63" status: 200 len: 1318 microversion: 2.1 time: 0.182949 May 26 12:48:32.768238 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 162/311] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:48:32 2022] GET /compute/v2.1/servers/9c87b8e9-adf1-40f0-b5d1-6efa2f25ab63 => generated 1318 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:32.771485 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-424d7538-3809-4588-87ef-197dbd0de4ea tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:32.773173 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-49cb5908-b1fe-4436-92aa-1c7f16c6b76c tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:32.773799 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-49cb5908-b1fe-4436-92aa-1c7f16c6b76c tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: 7aa85144-0ebe-430c-b9e5-9b656ea4560a] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:32.774072 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-424d7538-3809-4588-87ef-197dbd0de4ea tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:32.775902 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-424d7538-3809-4588-87ef-197dbd0de4ea tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa" status: 200 len: 1739 microversion: 2.20 time: 0.578814 May 26 12:48:32.779783 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-49cb5908-b1fe-4436-92aa-1c7f16c6b76c tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:32.780118 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 150/312] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:48:32 2022] GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa => generated 1739 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:48:32.780229 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-49cb5908-b1fe-4436-92aa-1c7f16c6b76c tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:32.780972 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-49cb5908-b1fe-4436-92aa-1c7f16c6b76c tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:32.781404 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-49cb5908-b1fe-4436-92aa-1c7f16c6b76c tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:32.917535 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-49cb5908-b1fe-4436-92aa-1c7f16c6b76c tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:32.925544 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-49cb5908-b1fe-4436-92aa-1c7f16c6b76c tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a" status: 200 len: 1370 microversion: 2.1 time: 0.156410 May 26 12:48:32.937771 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 163/313] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:48:32 2022] GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a => generated 1370 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:33.592756 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-01d0ab19-7bf3-4db2-82e5-b345f9c4d652 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:33.593476 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-01d0ab19-7bf3-4db2-82e5-b345f9c4d652 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: d6056156-21c7-47e2-9303-f90a8ec1b474] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:33.604012 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-01d0ab19-7bf3-4db2-82e5-b345f9c4d652 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:33.606994 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-01d0ab19-7bf3-4db2-82e5-b345f9c4d652 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:33.606994 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-01d0ab19-7bf3-4db2-82e5-b345f9c4d652 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:33.606994 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-01d0ab19-7bf3-4db2-82e5-b345f9c4d652 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:33.771675 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-01d0ab19-7bf3-4db2-82e5-b345f9c4d652 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0537911b91184fcdbdcc9e93ec3fe5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad768b45d17480d8d6bbbcff6032c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:33.781852 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-01d0ab19-7bf3-4db2-82e5-b345f9c4d652 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "GET /compute/v2.1/servers/d6056156-21c7-47e2-9303-f90a8ec1b474" status: 200 len: 1367 microversion: 2.1 time: 0.195499 May 26 12:48:33.782984 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 151/314] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:48:33 2022] GET /compute/v2.1/servers/d6056156-21c7-47e2-9303-f90a8ec1b474 => generated 1367 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:33.793131 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-c3fa2011-1de9-4d0f-a4b4-1724947cb124 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:33.793717 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-c3fa2011-1de9-4d0f-a4b4-1724947cb124 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] [instance: 9c87b8e9-adf1-40f0-b5d1-6efa2f25ab63] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:33.800980 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-c3fa2011-1de9-4d0f-a4b4-1724947cb124 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:33.801429 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-c3fa2011-1de9-4d0f-a4b4-1724947cb124 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:33.802220 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-c3fa2011-1de9-4d0f-a4b4-1724947cb124 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:33.802843 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-c3fa2011-1de9-4d0f-a4b4-1724947cb124 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:33.803593 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-36934a4c-71a2-43b2-b312-274c96fc0977 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:33.804208 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-36934a4c-71a2-43b2-b312-274c96fc0977 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 7ffbf048-2aa0-4656-a6cd-923b35031eaa] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:33.810469 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-36934a4c-71a2-43b2-b312-274c96fc0977 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:33.811198 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-36934a4c-71a2-43b2-b312-274c96fc0977 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:33.813847 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-36934a4c-71a2-43b2-b312-274c96fc0977 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:33.814493 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-36934a4c-71a2-43b2-b312-274c96fc0977 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:33.966738 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-c3fa2011-1de9-4d0f-a4b4-1724947cb124 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646a9abb1f9d4a1295a04defd895ff7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd539dfec943a44eb9b025d842a1f858d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:33.977925 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-c3fa2011-1de9-4d0f-a4b4-1724947cb124 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] 10.222.0.41 "GET /compute/v2.1/servers/9c87b8e9-adf1-40f0-b5d1-6efa2f25ab63" status: 200 len: 1507 microversion: 2.1 time: 0.196938 May 26 12:48:33.982119 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 164/315] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:48:33 2022] GET /compute/v2.1/servers/9c87b8e9-adf1-40f0-b5d1-6efa2f25ab63 => generated 1507 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:48:33.986352 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-7e0a5e8e-7c4d-430f-b67e-2ef2719134ec tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:33.986988 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-7e0a5e8e-7c4d-430f-b67e-2ef2719134ec tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: 7aa85144-0ebe-430c-b9e5-9b656ea4560a] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:33.995634 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-7e0a5e8e-7c4d-430f-b67e-2ef2719134ec tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:33.996479 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-7e0a5e8e-7c4d-430f-b67e-2ef2719134ec tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:33.997409 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-7e0a5e8e-7c4d-430f-b67e-2ef2719134ec tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:33.998016 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-7e0a5e8e-7c4d-430f-b67e-2ef2719134ec tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:34.009389 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-36934a4c-71a2-43b2-b312-274c96fc0977 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:34.014391 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG dbcounter [-] [124824] Writing DB stats nova_cell0:SELECT=4 {{(pid=124824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:34.027135 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-36934a4c-71a2-43b2-b312-274c96fc0977 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:34.031177 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-36934a4c-71a2-43b2-b312-274c96fc0977 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:34.035685 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-36934a4c-71a2-43b2-b312-274c96fc0977 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa" status: 200 len: 1739 microversion: 2.20 time: 0.236727 May 26 12:48:34.046923 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 152/316] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:48:33 2022] GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa => generated 1739 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:48:34.242399 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-7e0a5e8e-7c4d-430f-b67e-2ef2719134ec tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:34.253005 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-7e0a5e8e-7c4d-430f-b67e-2ef2719134ec tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a" status: 200 len: 1370 microversion: 2.1 time: 0.272814 May 26 12:48:34.271817 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 165/317] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:48:33 2022] GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a => generated 1370 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:34.800614 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-e77e0c2c-a2c3-4b06-8362-5a1ea3a1e5a5 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:34.802683 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-e77e0c2c-a2c3-4b06-8362-5a1ea3a1e5a5 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: d6056156-21c7-47e2-9303-f90a8ec1b474] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:34.814340 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-e77e0c2c-a2c3-4b06-8362-5a1ea3a1e5a5 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:34.818160 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-e77e0c2c-a2c3-4b06-8362-5a1ea3a1e5a5 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:34.820635 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-e77e0c2c-a2c3-4b06-8362-5a1ea3a1e5a5 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:34.821635 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-e77e0c2c-a2c3-4b06-8362-5a1ea3a1e5a5 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:35.022165 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-e77e0c2c-a2c3-4b06-8362-5a1ea3a1e5a5 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0537911b91184fcdbdcc9e93ec3fe5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad768b45d17480d8d6bbbcff6032c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:35.029973 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-e77e0c2c-a2c3-4b06-8362-5a1ea3a1e5a5 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "GET /compute/v2.1/servers/d6056156-21c7-47e2-9303-f90a8ec1b474" status: 200 len: 1367 microversion: 2.1 time: 0.233338 May 26 12:48:35.037691 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 153/318] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:48:34 2022] GET /compute/v2.1/servers/d6056156-21c7-47e2-9303-f90a8ec1b474 => generated 1367 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:35.055143 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-9c17b09e-c88a-463f-ab29-8be955113320 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:35.055768 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-9c17b09e-c88a-463f-ab29-8be955113320 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 7ffbf048-2aa0-4656-a6cd-923b35031eaa] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:35.061975 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG dbcounter [-] [124823] Writing DB stats nova_cell0:SELECT=2 {{(pid=124823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:35.063552 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG dbcounter [-] [124823] Writing DB stats nova_cell0:SELECT=14 {{(pid=124823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:35.066764 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-9c17b09e-c88a-463f-ab29-8be955113320 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:35.069151 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-9c17b09e-c88a-463f-ab29-8be955113320 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:35.069151 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-9c17b09e-c88a-463f-ab29-8be955113320 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:35.069151 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-9c17b09e-c88a-463f-ab29-8be955113320 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:35.278175 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-1bdfe4c1-1fd1-489c-ac93-83692b65305e tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:35.279685 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-1bdfe4c1-1fd1-489c-ac93-83692b65305e tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: 7aa85144-0ebe-430c-b9e5-9b656ea4560a] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:35.283349 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG dbcounter [-] [124824] Writing DB stats nova_cell0:SELECT=20 {{(pid=124824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:35.290606 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-1bdfe4c1-1fd1-489c-ac93-83692b65305e tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:35.292640 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-1bdfe4c1-1fd1-489c-ac93-83692b65305e tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:35.293136 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-1bdfe4c1-1fd1-489c-ac93-83692b65305e tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:35.293791 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-1bdfe4c1-1fd1-489c-ac93-83692b65305e tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:35.330964 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-9c17b09e-c88a-463f-ab29-8be955113320 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:35.344780 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-9c17b09e-c88a-463f-ab29-8be955113320 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:35.347052 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-9c17b09e-c88a-463f-ab29-8be955113320 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:35.349116 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-9c17b09e-c88a-463f-ab29-8be955113320 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa" status: 200 len: 1739 microversion: 2.20 time: 0.298502 May 26 12:48:35.351842 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 166/319] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:48:35 2022] GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa => generated 1739 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:48:35.485501 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-1bdfe4c1-1fd1-489c-ac93-83692b65305e tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:35.487735 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG dbcounter [-] [124824] Writing DB stats nova_cell1:SELECT=100 {{(pid=124824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:35.501397 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-1bdfe4c1-1fd1-489c-ac93-83692b65305e tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a" status: 200 len: 1370 microversion: 2.1 time: 0.221220 May 26 12:48:35.501397 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 154/320] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:48:35 2022] GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a => generated 1370 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:36.048389 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-6e8c31ad-57a7-4abb-9031-9c6a73c13954 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:36.049346 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-6e8c31ad-57a7-4abb-9031-9c6a73c13954 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: d6056156-21c7-47e2-9303-f90a8ec1b474] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:36.057599 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-6e8c31ad-57a7-4abb-9031-9c6a73c13954 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:36.058722 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-6e8c31ad-57a7-4abb-9031-9c6a73c13954 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:36.059491 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-6e8c31ad-57a7-4abb-9031-9c6a73c13954 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:36.060083 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-6e8c31ad-57a7-4abb-9031-9c6a73c13954 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:36.091969 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG dbcounter [-] [124823] Writing DB stats nova_cell1:SELECT=100 {{(pid=124823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:36.239412 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-6e8c31ad-57a7-4abb-9031-9c6a73c13954 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0537911b91184fcdbdcc9e93ec3fe5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad768b45d17480d8d6bbbcff6032c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:36.247743 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-6e8c31ad-57a7-4abb-9031-9c6a73c13954 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "GET /compute/v2.1/servers/d6056156-21c7-47e2-9303-f90a8ec1b474" status: 200 len: 1367 microversion: 2.1 time: 0.203613 May 26 12:48:36.249128 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 167/321] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:48:36 2022] GET /compute/v2.1/servers/d6056156-21c7-47e2-9303-f90a8ec1b474 => generated 1367 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:36.373494 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-2de66dfb-7feb-44f1-84bc-323bea8d9e9f tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:36.379609 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-2de66dfb-7feb-44f1-84bc-323bea8d9e9f tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 7ffbf048-2aa0-4656-a6cd-923b35031eaa] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:36.400411 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-2de66dfb-7feb-44f1-84bc-323bea8d9e9f tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:36.400874 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-2de66dfb-7feb-44f1-84bc-323bea8d9e9f tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:36.401738 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-2de66dfb-7feb-44f1-84bc-323bea8d9e9f tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:36.402328 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-2de66dfb-7feb-44f1-84bc-323bea8d9e9f tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:36.526090 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-ce088faa-1a75-4099-a361-d7e01b3ebc02 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:36.526727 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-ce088faa-1a75-4099-a361-d7e01b3ebc02 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: 7aa85144-0ebe-430c-b9e5-9b656ea4560a] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:36.536753 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-ce088faa-1a75-4099-a361-d7e01b3ebc02 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:36.537779 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-ce088faa-1a75-4099-a361-d7e01b3ebc02 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:36.542990 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-ce088faa-1a75-4099-a361-d7e01b3ebc02 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:36.543457 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-ce088faa-1a75-4099-a361-d7e01b3ebc02 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:36.675432 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-2de66dfb-7feb-44f1-84bc-323bea8d9e9f tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:36.692445 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-2de66dfb-7feb-44f1-84bc-323bea8d9e9f tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:36.696718 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-2de66dfb-7feb-44f1-84bc-323bea8d9e9f tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:36.698282 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-2de66dfb-7feb-44f1-84bc-323bea8d9e9f tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa" status: 200 len: 1739 microversion: 2.20 time: 0.330369 May 26 12:48:36.700195 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 155/322] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:48:36 2022] GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa => generated 1739 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:48:36.723671 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-ce088faa-1a75-4099-a361-d7e01b3ebc02 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:36.732835 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-ce088faa-1a75-4099-a361-d7e01b3ebc02 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a" status: 200 len: 1370 microversion: 2.1 time: 0.211135 May 26 12:48:36.733425 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 168/323] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:48:36 2022] GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a => generated 1370 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:37.266471 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-449d00a6-b5cb-4324-b8d6-e8fda88662b3 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:37.268775 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-449d00a6-b5cb-4324-b8d6-e8fda88662b3 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: d6056156-21c7-47e2-9303-f90a8ec1b474] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:37.275380 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-449d00a6-b5cb-4324-b8d6-e8fda88662b3 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:37.276081 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-449d00a6-b5cb-4324-b8d6-e8fda88662b3 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:37.277178 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-449d00a6-b5cb-4324-b8d6-e8fda88662b3 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:37.277614 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-449d00a6-b5cb-4324-b8d6-e8fda88662b3 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:37.434816 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-449d00a6-b5cb-4324-b8d6-e8fda88662b3 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0537911b91184fcdbdcc9e93ec3fe5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad768b45d17480d8d6bbbcff6032c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:37.441970 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-449d00a6-b5cb-4324-b8d6-e8fda88662b3 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "GET /compute/v2.1/servers/d6056156-21c7-47e2-9303-f90a8ec1b474" status: 200 len: 1367 microversion: 2.1 time: 0.179228 May 26 12:48:37.442544 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 156/324] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:48:37 2022] GET /compute/v2.1/servers/d6056156-21c7-47e2-9303-f90a8ec1b474 => generated 1367 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:37.726790 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-ca349b4f-587a-4e85-a9be-41b4577fd518 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:37.727400 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-ca349b4f-587a-4e85-a9be-41b4577fd518 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 7ffbf048-2aa0-4656-a6cd-923b35031eaa] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:37.740392 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-ca349b4f-587a-4e85-a9be-41b4577fd518 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:37.740887 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-ca349b4f-587a-4e85-a9be-41b4577fd518 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:37.741733 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-ca349b4f-587a-4e85-a9be-41b4577fd518 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:37.742187 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-ca349b4f-587a-4e85-a9be-41b4577fd518 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:37.765720 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-7ecb0d4a-00ed-4f96-920e-8ebd3e0f6a67 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:37.766498 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-7ecb0d4a-00ed-4f96-920e-8ebd3e0f6a67 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: 7aa85144-0ebe-430c-b9e5-9b656ea4560a] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:37.782412 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-7ecb0d4a-00ed-4f96-920e-8ebd3e0f6a67 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:37.785075 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-7ecb0d4a-00ed-4f96-920e-8ebd3e0f6a67 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:37.791104 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-7ecb0d4a-00ed-4f96-920e-8ebd3e0f6a67 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:37.792065 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-7ecb0d4a-00ed-4f96-920e-8ebd3e0f6a67 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:37.957789 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-ca349b4f-587a-4e85-a9be-41b4577fd518 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:37.970409 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-ca349b4f-587a-4e85-a9be-41b4577fd518 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:37.972142 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-ca349b4f-587a-4e85-a9be-41b4577fd518 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:37.973532 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-ca349b4f-587a-4e85-a9be-41b4577fd518 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa" status: 200 len: 1739 microversion: 2.20 time: 0.256847 May 26 12:48:37.975211 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 169/325] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:48:37 2022] GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa => generated 1739 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:48:38.122488 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-7ecb0d4a-00ed-4f96-920e-8ebd3e0f6a67 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:38.131783 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-7ecb0d4a-00ed-4f96-920e-8ebd3e0f6a67 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a" status: 200 len: 1370 microversion: 2.1 time: 0.384695 May 26 12:48:38.133769 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 157/326] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:48:37 2022] GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a => generated 1370 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:38.145594 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [req-7aa64356-fb65-402d-9c3c-d9416aa242fa req-424434be-a902-45f0-b7c8-a39d606818b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7aa85144-0ebe-430c-b9e5-9b656ea4560a", "name": "network-vif-plugged", "status": "completed", "tag": "e5a6930c-e135-4546-bcdc-823bfe4c6e87"}]} {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:48:38.155875 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [req-7aa64356-fb65-402d-9c3c-d9416aa242fa req-424434be-a902-45f0-b7c8-a39d606818b6 service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:38.156458 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [req-7aa64356-fb65-402d-9c3c-d9416aa242fa req-424434be-a902-45f0-b7c8-a39d606818b6 service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:38.168450 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.compute.server_external_events [req-7aa64356-fb65-402d-9c3c-d9416aa242fa req-424434be-a902-45f0-b7c8-a39d606818b6 service nova] Creating event network-vif-plugged:e5a6930c-e135-4546-bcdc-823bfe4c6e87 for instance 7aa85144-0ebe-430c-b9e5-9b656ea4560a on hv-cinder-81571 May 26 12:48:38.176990 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [req-7aa64356-fb65-402d-9c3c-d9416aa242fa req-424434be-a902-45f0-b7c8-a39d606818b6 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032363 May 26 12:48:38.176990 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 170/327] 10.222.0.41 () {64 vars in 1317 bytes} [Thu May 26 12:48:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:48:38.460810 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-33838f3d-30c3-4833-af2d-97148803c529 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:38.461607 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-33838f3d-30c3-4833-af2d-97148803c529 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: d6056156-21c7-47e2-9303-f90a8ec1b474] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:38.468567 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-33838f3d-30c3-4833-af2d-97148803c529 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:38.469144 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-33838f3d-30c3-4833-af2d-97148803c529 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:38.470219 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-33838f3d-30c3-4833-af2d-97148803c529 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:38.470901 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-33838f3d-30c3-4833-af2d-97148803c529 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:38.723740 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-33838f3d-30c3-4833-af2d-97148803c529 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0537911b91184fcdbdcc9e93ec3fe5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad768b45d17480d8d6bbbcff6032c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:38.736912 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-33838f3d-30c3-4833-af2d-97148803c529 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "GET /compute/v2.1/servers/d6056156-21c7-47e2-9303-f90a8ec1b474" status: 200 len: 1367 microversion: 2.1 time: 0.280424 May 26 12:48:38.750630 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 158/328] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:48:38 2022] GET /compute/v2.1/servers/d6056156-21c7-47e2-9303-f90a8ec1b474 => generated 1367 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:38.994124 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-5a808e16-74e3-4c01-9381-0c9f58b18f31 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:38.994849 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-5a808e16-74e3-4c01-9381-0c9f58b18f31 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 7ffbf048-2aa0-4656-a6cd-923b35031eaa] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:39.005273 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-5a808e16-74e3-4c01-9381-0c9f58b18f31 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:39.006104 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-5a808e16-74e3-4c01-9381-0c9f58b18f31 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:39.007059 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-5a808e16-74e3-4c01-9381-0c9f58b18f31 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:39.007641 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-5a808e16-74e3-4c01-9381-0c9f58b18f31 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:39.148910 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-11c95eb1-c574-487e-bca1-af50b8fb9c4f tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:39.149773 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-11c95eb1-c574-487e-bca1-af50b8fb9c4f tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: 7aa85144-0ebe-430c-b9e5-9b656ea4560a] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:39.161773 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-11c95eb1-c574-487e-bca1-af50b8fb9c4f tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:39.166446 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-11c95eb1-c574-487e-bca1-af50b8fb9c4f tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:39.166446 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-11c95eb1-c574-487e-bca1-af50b8fb9c4f tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:39.166446 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-11c95eb1-c574-487e-bca1-af50b8fb9c4f tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:39.184791 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-5a808e16-74e3-4c01-9381-0c9f58b18f31 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:39.198290 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-5a808e16-74e3-4c01-9381-0c9f58b18f31 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:39.199538 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-5a808e16-74e3-4c01-9381-0c9f58b18f31 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:39.200716 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-5a808e16-74e3-4c01-9381-0c9f58b18f31 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa" status: 200 len: 1739 microversion: 2.20 time: 0.211664 May 26 12:48:39.201813 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 171/329] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:48:38 2022] GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa => generated 1739 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:48:39.319055 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-11c95eb1-c574-487e-bca1-af50b8fb9c4f tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:39.327545 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-11c95eb1-c574-487e-bca1-af50b8fb9c4f tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a" status: 200 len: 1370 microversion: 2.1 time: 0.183046 May 26 12:48:39.328151 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 159/330] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:48:39 2022] GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a => generated 1370 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:48:39.757103 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-ee2afd49-0aef-47ae-afc4-f41080aeff64 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:39.784658 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-ee2afd49-0aef-47ae-afc4-f41080aeff64 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: d6056156-21c7-47e2-9303-f90a8ec1b474] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:39.784658 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-ee2afd49-0aef-47ae-afc4-f41080aeff64 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:39.784658 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-ee2afd49-0aef-47ae-afc4-f41080aeff64 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:39.784658 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-ee2afd49-0aef-47ae-afc4-f41080aeff64 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:39.785063 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-ee2afd49-0aef-47ae-afc4-f41080aeff64 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:39.960119 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-ee2afd49-0aef-47ae-afc4-f41080aeff64 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0537911b91184fcdbdcc9e93ec3fe5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad768b45d17480d8d6bbbcff6032c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:39.968520 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-ee2afd49-0aef-47ae-afc4-f41080aeff64 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "GET /compute/v2.1/servers/d6056156-21c7-47e2-9303-f90a8ec1b474" status: 200 len: 1367 microversion: 2.1 time: 0.218147 May 26 12:48:39.969775 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 172/331] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:48:39 2022] GET /compute/v2.1/servers/d6056156-21c7-47e2-9303-f90a8ec1b474 => generated 1367 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:40.218469 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-f01d1e6c-d0a8-4d22-85e1-f03f78195c41 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:40.219946 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-f01d1e6c-d0a8-4d22-85e1-f03f78195c41 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 7ffbf048-2aa0-4656-a6cd-923b35031eaa] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:40.230421 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-f01d1e6c-d0a8-4d22-85e1-f03f78195c41 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:40.231264 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-f01d1e6c-d0a8-4d22-85e1-f03f78195c41 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:40.232148 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-f01d1e6c-d0a8-4d22-85e1-f03f78195c41 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:40.232780 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-f01d1e6c-d0a8-4d22-85e1-f03f78195c41 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:40.331261 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [req-eeaec704-bcec-4baf-9a58-d5c1d3cb56ba req-80663da2-bff1-4cfa-97e7-54191a4b10d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6056156-21c7-47e2-9303-f90a8ec1b474", "name": "network-vif-plugged", "status": "completed", "tag": "141703c8-60fb-4601-9241-65a9a0f37d8d"}]} {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:48:40.343422 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [req-eeaec704-bcec-4baf-9a58-d5c1d3cb56ba req-80663da2-bff1-4cfa-97e7-54191a4b10d1 service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:40.343867 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [req-eeaec704-bcec-4baf-9a58-d5c1d3cb56ba req-80663da2-bff1-4cfa-97e7-54191a4b10d1 service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:40.355808 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.compute.server_external_events [req-eeaec704-bcec-4baf-9a58-d5c1d3cb56ba req-80663da2-bff1-4cfa-97e7-54191a4b10d1 service nova] Creating event network-vif-plugged:141703c8-60fb-4601-9241-65a9a0f37d8d for instance d6056156-21c7-47e2-9303-f90a8ec1b474 on hv-cinder-81571 May 26 12:48:40.361545 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [req-eeaec704-bcec-4baf-9a58-d5c1d3cb56ba req-80663da2-bff1-4cfa-97e7-54191a4b10d1 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038473 May 26 12:48:40.362197 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 173/332] 10.222.0.41 () {64 vars in 1317 bytes} [Thu May 26 12:48:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:48:40.367902 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-82a25f6a-22c1-44c9-8816-4f2780137b05 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:40.368763 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-82a25f6a-22c1-44c9-8816-4f2780137b05 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: 7aa85144-0ebe-430c-b9e5-9b656ea4560a] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:40.374223 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG dbcounter [-] [124823] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=124823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:40.376077 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-82a25f6a-22c1-44c9-8816-4f2780137b05 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:40.376497 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-82a25f6a-22c1-44c9-8816-4f2780137b05 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:40.377270 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-82a25f6a-22c1-44c9-8816-4f2780137b05 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:40.377729 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-82a25f6a-22c1-44c9-8816-4f2780137b05 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:40.428919 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-f01d1e6c-d0a8-4d22-85e1-f03f78195c41 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:40.437324 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-f01d1e6c-d0a8-4d22-85e1-f03f78195c41 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:40.438966 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-f01d1e6c-d0a8-4d22-85e1-f03f78195c41 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:40.440205 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-f01d1e6c-d0a8-4d22-85e1-f03f78195c41 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa" status: 200 len: 1739 microversion: 2.20 time: 0.225667 May 26 12:48:40.440770 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 160/333] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:48:40 2022] GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa => generated 1739 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:48:40.541895 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-82a25f6a-22c1-44c9-8816-4f2780137b05 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:40.549487 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-82a25f6a-22c1-44c9-8816-4f2780137b05 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a" status: 200 len: 1370 microversion: 2.1 time: 0.185891 May 26 12:48:40.550093 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 174/334] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:48:40 2022] GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a => generated 1370 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:40.986952 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-d76268c8-f7fe-4ce7-a79e-202873a5bb61 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:40.988065 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-d76268c8-f7fe-4ce7-a79e-202873a5bb61 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: d6056156-21c7-47e2-9303-f90a8ec1b474] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:40.995790 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-d76268c8-f7fe-4ce7-a79e-202873a5bb61 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:40.996515 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-d76268c8-f7fe-4ce7-a79e-202873a5bb61 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:41.009390 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-d76268c8-f7fe-4ce7-a79e-202873a5bb61 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:41.009390 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-d76268c8-f7fe-4ce7-a79e-202873a5bb61 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:41.172740 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-d76268c8-f7fe-4ce7-a79e-202873a5bb61 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0537911b91184fcdbdcc9e93ec3fe5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad768b45d17480d8d6bbbcff6032c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:41.184773 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-d76268c8-f7fe-4ce7-a79e-202873a5bb61 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "GET /compute/v2.1/servers/d6056156-21c7-47e2-9303-f90a8ec1b474" status: 200 len: 1367 microversion: 2.1 time: 0.201664 May 26 12:48:41.186602 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 161/335] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:48:40 2022] GET /compute/v2.1/servers/d6056156-21c7-47e2-9303-f90a8ec1b474 => generated 1367 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:41.459856 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-f6c7f5de-f7b3-48bb-aeae-224dfcb77de3 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:41.460469 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-f6c7f5de-f7b3-48bb-aeae-224dfcb77de3 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 7ffbf048-2aa0-4656-a6cd-923b35031eaa] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:41.468815 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-f6c7f5de-f7b3-48bb-aeae-224dfcb77de3 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:41.469264 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-f6c7f5de-f7b3-48bb-aeae-224dfcb77de3 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:41.470078 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-f6c7f5de-f7b3-48bb-aeae-224dfcb77de3 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:41.470521 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-f6c7f5de-f7b3-48bb-aeae-224dfcb77de3 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:41.568493 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-4bf8edb8-04e6-4c8a-ac52-6c687e3697fa tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:41.568493 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-4bf8edb8-04e6-4c8a-ac52-6c687e3697fa tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: 7aa85144-0ebe-430c-b9e5-9b656ea4560a] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:41.573732 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-4bf8edb8-04e6-4c8a-ac52-6c687e3697fa tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:41.574257 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-4bf8edb8-04e6-4c8a-ac52-6c687e3697fa tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:41.575104 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-4bf8edb8-04e6-4c8a-ac52-6c687e3697fa tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:41.575613 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-4bf8edb8-04e6-4c8a-ac52-6c687e3697fa tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:41.628301 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-f6c7f5de-f7b3-48bb-aeae-224dfcb77de3 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:41.636667 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-f6c7f5de-f7b3-48bb-aeae-224dfcb77de3 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:41.638230 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-f6c7f5de-f7b3-48bb-aeae-224dfcb77de3 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:41.639393 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-f6c7f5de-f7b3-48bb-aeae-224dfcb77de3 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa" status: 200 len: 1739 microversion: 2.20 time: 0.184591 May 26 12:48:41.640154 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 175/336] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:48:41 2022] GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa => generated 1739 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:48:41.730615 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-4bf8edb8-04e6-4c8a-ac52-6c687e3697fa tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:41.738126 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-4bf8edb8-04e6-4c8a-ac52-6c687e3697fa tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a" status: 200 len: 1563 microversion: 2.1 time: 0.175651 May 26 12:48:41.745485 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 162/337] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:48:41 2022] GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a => generated 1563 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:48:41.760735 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-321d7708-36a6-4008-afd5-3cac4d5d8694 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:41.761178 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-321d7708-36a6-4008-afd5-3cac4d5d8694 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: 7aa85144-0ebe-430c-b9e5-9b656ea4560a] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:41.767301 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-321d7708-36a6-4008-afd5-3cac4d5d8694 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:41.767754 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-321d7708-36a6-4008-afd5-3cac4d5d8694 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:41.768519 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-321d7708-36a6-4008-afd5-3cac4d5d8694 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:41.768964 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-321d7708-36a6-4008-afd5-3cac4d5d8694 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:41.845774 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-321d7708-36a6-4008-afd5-3cac4d5d8694 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089454 May 26 12:48:41.846604 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 176/338] 10.222.0.41 () {58 vars in 1274 bytes} [Thu May 26 12:48:41 2022] GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:48:42.203611 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-25675032-d8d1-4a01-8828-b06acc0ff95b tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:42.204300 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-25675032-d8d1-4a01-8828-b06acc0ff95b tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: d6056156-21c7-47e2-9303-f90a8ec1b474] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:42.212471 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-25675032-d8d1-4a01-8828-b06acc0ff95b tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:42.212812 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-25675032-d8d1-4a01-8828-b06acc0ff95b tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:42.214034 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-25675032-d8d1-4a01-8828-b06acc0ff95b tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:42.214781 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-25675032-d8d1-4a01-8828-b06acc0ff95b tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:42.360756 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-25675032-d8d1-4a01-8828-b06acc0ff95b tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0537911b91184fcdbdcc9e93ec3fe5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad768b45d17480d8d6bbbcff6032c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:42.370017 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-25675032-d8d1-4a01-8828-b06acc0ff95b tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "GET /compute/v2.1/servers/d6056156-21c7-47e2-9303-f90a8ec1b474" status: 200 len: 1367 microversion: 2.1 time: 0.170444 May 26 12:48:42.379360 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 163/339] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:48:42 2022] GET /compute/v2.1/servers/d6056156-21c7-47e2-9303-f90a8ec1b474 => generated 1367 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:42.666165 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-7a5e057d-ce7a-4e0c-ba72-8779aae7112d tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:42.666822 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-7a5e057d-ce7a-4e0c-ba72-8779aae7112d tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 7ffbf048-2aa0-4656-a6cd-923b35031eaa] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:42.673035 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-7a5e057d-ce7a-4e0c-ba72-8779aae7112d tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:42.680749 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-7a5e057d-ce7a-4e0c-ba72-8779aae7112d tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:42.680749 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-7a5e057d-ce7a-4e0c-ba72-8779aae7112d tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:42.680749 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-7a5e057d-ce7a-4e0c-ba72-8779aae7112d tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:42.924363 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-7a5e057d-ce7a-4e0c-ba72-8779aae7112d tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:42.926865 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-7a5e057d-ce7a-4e0c-ba72-8779aae7112d tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:42.928882 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-7a5e057d-ce7a-4e0c-ba72-8779aae7112d tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:42.930078 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-7a5e057d-ce7a-4e0c-ba72-8779aae7112d tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa" status: 200 len: 1739 microversion: 2.20 time: 0.269317 May 26 12:48:42.930643 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 177/340] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:48:42 2022] GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa => generated 1739 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:48:43.175917 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [req-ce4821e5-fc34-42c9-b674-e3c073db6f7e req-19a1640e-efae-4758-b02e-16c983452e59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7aa85144-0ebe-430c-b9e5-9b656ea4560a", "tag": "e5a6930c-e135-4546-bcdc-823bfe4c6e87"}]} {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:48:43.184887 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [req-ce4821e5-fc34-42c9-b674-e3c073db6f7e req-19a1640e-efae-4758-b02e-16c983452e59 service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:43.185337 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [req-ce4821e5-fc34-42c9-b674-e3c073db6f7e req-19a1640e-efae-4758-b02e-16c983452e59 service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:43.197069 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.compute.server_external_events [req-ce4821e5-fc34-42c9-b674-e3c073db6f7e req-19a1640e-efae-4758-b02e-16c983452e59 service nova] Creating event network-changed:e5a6930c-e135-4546-bcdc-823bfe4c6e87 for instance 7aa85144-0ebe-430c-b9e5-9b656ea4560a on hv-cinder-81571 May 26 12:48:43.202346 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [req-ce4821e5-fc34-42c9-b674-e3c073db6f7e req-19a1640e-efae-4758-b02e-16c983452e59 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030260 May 26 12:48:43.202942 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 164/341] 10.222.0.41 () {64 vars in 1317 bytes} [Thu May 26 12:48:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:48:43.388363 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-4d143c33-0bbf-4c84-b1b8-f105c1ea13cc tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:43.388970 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-4d143c33-0bbf-4c84-b1b8-f105c1ea13cc tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: d6056156-21c7-47e2-9303-f90a8ec1b474] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:43.395148 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-4d143c33-0bbf-4c84-b1b8-f105c1ea13cc tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:43.395591 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-4d143c33-0bbf-4c84-b1b8-f105c1ea13cc tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:43.396365 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-4d143c33-0bbf-4c84-b1b8-f105c1ea13cc tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:43.396795 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-4d143c33-0bbf-4c84-b1b8-f105c1ea13cc tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:43.660319 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-4d143c33-0bbf-4c84-b1b8-f105c1ea13cc tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0537911b91184fcdbdcc9e93ec3fe5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad768b45d17480d8d6bbbcff6032c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:43.675758 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-4d143c33-0bbf-4c84-b1b8-f105c1ea13cc tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "GET /compute/v2.1/servers/d6056156-21c7-47e2-9303-f90a8ec1b474" status: 200 len: 1556 microversion: 2.1 time: 0.290468 May 26 12:48:43.680984 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 178/342] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:48:43 2022] GET /compute/v2.1/servers/d6056156-21c7-47e2-9303-f90a8ec1b474 => generated 1556 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:48:43.702215 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-af003d0d-f975-48aa-8365-985fc91123d3 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:43.703058 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-af003d0d-f975-48aa-8365-985fc91123d3 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: d6056156-21c7-47e2-9303-f90a8ec1b474] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:43.710552 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-af003d0d-f975-48aa-8365-985fc91123d3 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:43.711231 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-af003d0d-f975-48aa-8365-985fc91123d3 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:43.712152 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-af003d0d-f975-48aa-8365-985fc91123d3 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:43.712738 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-af003d0d-f975-48aa-8365-985fc91123d3 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:43.828487 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-af003d0d-f975-48aa-8365-985fc91123d3 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "GET /compute/v2.1/servers/d6056156-21c7-47e2-9303-f90a8ec1b474/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.130387 May 26 12:48:43.829116 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 165/343] 10.222.0.41 () {58 vars in 1274 bytes} [Thu May 26 12:48:43 2022] GET /compute/v2.1/servers/d6056156-21c7-47e2-9303-f90a8ec1b474/os-interface => generated 284 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:48:43.949001 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-48d79144-c49a-4392-8872-6ea9f8c29fc4 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:43.950004 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-48d79144-c49a-4392-8872-6ea9f8c29fc4 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 7ffbf048-2aa0-4656-a6cd-923b35031eaa] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:43.956304 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-48d79144-c49a-4392-8872-6ea9f8c29fc4 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:43.957103 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-48d79144-c49a-4392-8872-6ea9f8c29fc4 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:43.958116 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-48d79144-c49a-4392-8872-6ea9f8c29fc4 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:43.958740 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-48d79144-c49a-4392-8872-6ea9f8c29fc4 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:44.576744 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-48d79144-c49a-4392-8872-6ea9f8c29fc4 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:44.585279 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-48d79144-c49a-4392-8872-6ea9f8c29fc4 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:44.586921 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-48d79144-c49a-4392-8872-6ea9f8c29fc4 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:44.588150 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-48d79144-c49a-4392-8872-6ea9f8c29fc4 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa" status: 200 len: 1721 microversion: 2.20 time: 0.643104 May 26 12:48:44.588791 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 179/344] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:48:43 2022] GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa => generated 1721 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:48:45.430199 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [req-100b6095-fd9d-45cb-bc13-7137ee651902 req-dffa803c-19b0-45d2-9430-841c3e5abcd6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6056156-21c7-47e2-9303-f90a8ec1b474", "tag": "141703c8-60fb-4601-9241-65a9a0f37d8d"}]} {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:48:45.438476 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [req-100b6095-fd9d-45cb-bc13-7137ee651902 req-dffa803c-19b0-45d2-9430-841c3e5abcd6 service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:45.439305 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [req-100b6095-fd9d-45cb-bc13-7137ee651902 req-dffa803c-19b0-45d2-9430-841c3e5abcd6 service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:45.452704 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.compute.server_external_events [req-100b6095-fd9d-45cb-bc13-7137ee651902 req-dffa803c-19b0-45d2-9430-841c3e5abcd6 service nova] Creating event network-changed:141703c8-60fb-4601-9241-65a9a0f37d8d for instance d6056156-21c7-47e2-9303-f90a8ec1b474 on hv-cinder-81571 May 26 12:48:45.457856 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [req-100b6095-fd9d-45cb-bc13-7137ee651902 req-dffa803c-19b0-45d2-9430-841c3e5abcd6 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031983 May 26 12:48:45.458544 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 166/345] 10.222.0.41 () {64 vars in 1317 bytes} [Thu May 26 12:48:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:48:45.606357 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-54b02e05-57ab-4b92-8f75-4f97a3d5b39a tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:45.606968 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-54b02e05-57ab-4b92-8f75-4f97a3d5b39a tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 7ffbf048-2aa0-4656-a6cd-923b35031eaa] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:45.614409 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-54b02e05-57ab-4b92-8f75-4f97a3d5b39a tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:45.614854 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-54b02e05-57ab-4b92-8f75-4f97a3d5b39a tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:45.615693 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-54b02e05-57ab-4b92-8f75-4f97a3d5b39a tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:45.616119 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-54b02e05-57ab-4b92-8f75-4f97a3d5b39a tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:45.780855 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-54b02e05-57ab-4b92-8f75-4f97a3d5b39a tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:45.789278 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-54b02e05-57ab-4b92-8f75-4f97a3d5b39a tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:45.790860 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-54b02e05-57ab-4b92-8f75-4f97a3d5b39a tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:45.794948 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-54b02e05-57ab-4b92-8f75-4f97a3d5b39a tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa" status: 200 len: 1721 microversion: 2.20 time: 0.192518 May 26 12:48:45.808887 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 180/346] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:48:45 2022] GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa => generated 1721 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:48:45.884618 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [req-f3ee25dc-3e44-4342-bda7-4d8528728ca0 req-7be92752-d536-4c35-ac53-e4f206c72534 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ffbf048-2aa0-4656-a6cd-923b35031eaa", "name": "network-vif-unplugged", "status": "completed", "tag": "979ef417-a463-49c2-a7ae-7fae04d77dd9"}]} {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:48:45.894182 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [req-f3ee25dc-3e44-4342-bda7-4d8528728ca0 req-7be92752-d536-4c35-ac53-e4f206c72534 service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:45.895057 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [req-f3ee25dc-3e44-4342-bda7-4d8528728ca0 req-7be92752-d536-4c35-ac53-e4f206c72534 service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:45.907720 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.compute.server_external_events [req-f3ee25dc-3e44-4342-bda7-4d8528728ca0 req-7be92752-d536-4c35-ac53-e4f206c72534 service nova] Creating event network-vif-unplugged:979ef417-a463-49c2-a7ae-7fae04d77dd9 for instance 7ffbf048-2aa0-4656-a6cd-923b35031eaa on hv-cinder-81571 May 26 12:48:45.913406 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [req-f3ee25dc-3e44-4342-bda7-4d8528728ca0 req-7be92752-d536-4c35-ac53-e4f206c72534 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036465 May 26 12:48:45.914175 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 167/347] 10.222.0.41 () {64 vars in 1317 bytes} [Thu May 26 12:48:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:48:46.813313 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-2a9668d4-f9df-4e0e-b5df-427093b8d8e6 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:46.813953 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-2a9668d4-f9df-4e0e-b5df-427093b8d8e6 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 7ffbf048-2aa0-4656-a6cd-923b35031eaa] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:46.820809 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-2a9668d4-f9df-4e0e-b5df-427093b8d8e6 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:46.821276 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-2a9668d4-f9df-4e0e-b5df-427093b8d8e6 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:46.822160 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-2a9668d4-f9df-4e0e-b5df-427093b8d8e6 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:46.822530 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-2a9668d4-f9df-4e0e-b5df-427093b8d8e6 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:46.985547 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-2a9668d4-f9df-4e0e-b5df-427093b8d8e6 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:46.994543 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-2a9668d4-f9df-4e0e-b5df-427093b8d8e6 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:46.996059 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-2a9668d4-f9df-4e0e-b5df-427093b8d8e6 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:46.997215 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-2a9668d4-f9df-4e0e-b5df-427093b8d8e6 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa" status: 200 len: 1724 microversion: 2.20 time: 0.188027 May 26 12:48:46.997868 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 181/348] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:48:46 2022] GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa => generated 1724 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:48:47.016843 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-1fb58716-f1d9-4843-8b3d-785004e8c8d9 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4af30dca-103f-40fc-a0a0-c3f58507c189"}} {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:48:47.018872 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-1fb58716-f1d9-4843-8b3d-785004e8c8d9 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 7ffbf048-2aa0-4656-a6cd-923b35031eaa] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:47.027596 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-1fb58716-f1d9-4843-8b3d-785004e8c8d9 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:47.044673 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-1fb58716-f1d9-4843-8b3d-785004e8c8d9 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:47.046146 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-1fb58716-f1d9-4843-8b3d-785004e8c8d9 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:47.046659 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-1fb58716-f1d9-4843-8b3d-785004e8c8d9 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:48.252877 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-1fb58716-f1d9-4843-8b3d-785004e8c8d9 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "POST /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.241005 May 26 12:48:48.253533 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 168/349] 10.222.0.41 () {62 vars in 1363 bytes} [Thu May 26 12:48:47 2022] POST /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa/os-volume_attachments => generated 188 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 12:48:48.387355 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-208396d9-5843-4fc2-9d76-6deb8793b88a tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:48:48.388160 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-208396d9-5843-4fc2-9d76-6deb8793b88a tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 7ffbf048-2aa0-4656-a6cd-923b35031eaa] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:48.394808 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-208396d9-5843-4fc2-9d76-6deb8793b88a tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:48.395471 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-208396d9-5843-4fc2-9d76-6deb8793b88a tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:48.396373 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-208396d9-5843-4fc2-9d76-6deb8793b88a tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:48.397489 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-208396d9-5843-4fc2-9d76-6deb8793b88a tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:48.651854 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-208396d9-5843-4fc2-9d76-6deb8793b88a tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "POST /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa/action" status: 202 len: 0 microversion: 2.20 time: 0.268445 May 26 12:48:48.655536 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 182/350] 10.222.0.41 () {62 vars in 1318 bytes} [Thu May 26 12:48:48 2022] POST /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa/action => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 26 12:48:48.660968 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-3acaeb4c-0dbb-42c4-b012-4b6e15e60066 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:48.661512 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-3acaeb4c-0dbb-42c4-b012-4b6e15e60066 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 7ffbf048-2aa0-4656-a6cd-923b35031eaa] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:48.668643 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-3acaeb4c-0dbb-42c4-b012-4b6e15e60066 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:48.669085 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-3acaeb4c-0dbb-42c4-b012-4b6e15e60066 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:48.669944 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-3acaeb4c-0dbb-42c4-b012-4b6e15e60066 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:48.670402 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-3acaeb4c-0dbb-42c4-b012-4b6e15e60066 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:48.807773 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-3acaeb4c-0dbb-42c4-b012-4b6e15e60066 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:48.816118 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-3acaeb4c-0dbb-42c4-b012-4b6e15e60066 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:48.817630 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-3acaeb4c-0dbb-42c4-b012-4b6e15e60066 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:48.818870 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-3acaeb4c-0dbb-42c4-b012-4b6e15e60066 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa" status: 200 len: 1750 microversion: 2.20 time: 0.161900 May 26 12:48:48.819427 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 169/351] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:48:48 2022] GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa => generated 1750 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:48:49.838522 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-9cf5da96-dedb-4daa-8fa1-dd73a4ff6ed5 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:49.839155 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-9cf5da96-dedb-4daa-8fa1-dd73a4ff6ed5 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 7ffbf048-2aa0-4656-a6cd-923b35031eaa] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:49.846017 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-9cf5da96-dedb-4daa-8fa1-dd73a4ff6ed5 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:49.846482 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-9cf5da96-dedb-4daa-8fa1-dd73a4ff6ed5 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:49.847328 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-9cf5da96-dedb-4daa-8fa1-dd73a4ff6ed5 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:49.847763 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-9cf5da96-dedb-4daa-8fa1-dd73a4ff6ed5 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:49.994920 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-9cf5da96-dedb-4daa-8fa1-dd73a4ff6ed5 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:50.003247 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-9cf5da96-dedb-4daa-8fa1-dd73a4ff6ed5 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:50.004753 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-9cf5da96-dedb-4daa-8fa1-dd73a4ff6ed5 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:50.006017 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-9cf5da96-dedb-4daa-8fa1-dd73a4ff6ed5 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa" status: 200 len: 1750 microversion: 2.20 time: 0.172245 May 26 12:48:50.007076 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 183/352] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:48:49 2022] GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa => generated 1750 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:48:51.024911 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-0e1728f2-2e42-4375-b80d-2b766b68ad75 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:51.025682 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-0e1728f2-2e42-4375-b80d-2b766b68ad75 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 7ffbf048-2aa0-4656-a6cd-923b35031eaa] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:51.040903 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-0e1728f2-2e42-4375-b80d-2b766b68ad75 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:51.040903 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-0e1728f2-2e42-4375-b80d-2b766b68ad75 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:51.040903 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-0e1728f2-2e42-4375-b80d-2b766b68ad75 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:51.040903 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-0e1728f2-2e42-4375-b80d-2b766b68ad75 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:51.168753 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-0e1728f2-2e42-4375-b80d-2b766b68ad75 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:51.176962 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-0e1728f2-2e42-4375-b80d-2b766b68ad75 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:51.178524 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-0e1728f2-2e42-4375-b80d-2b766b68ad75 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:51.179672 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-0e1728f2-2e42-4375-b80d-2b766b68ad75 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa" status: 200 len: 1752 microversion: 2.20 time: 0.158679 May 26 12:48:51.180234 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 170/353] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:48:51 2022] GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa => generated 1752 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:48:52.198600 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-dcd28315-c13c-4ad4-9ee6-109c15da0f65 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:52.199319 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-dcd28315-c13c-4ad4-9ee6-109c15da0f65 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 7ffbf048-2aa0-4656-a6cd-923b35031eaa] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:52.205906 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-dcd28315-c13c-4ad4-9ee6-109c15da0f65 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:52.206333 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-dcd28315-c13c-4ad4-9ee6-109c15da0f65 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:52.207088 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-dcd28315-c13c-4ad4-9ee6-109c15da0f65 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:52.207518 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-dcd28315-c13c-4ad4-9ee6-109c15da0f65 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:52.333303 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-dcd28315-c13c-4ad4-9ee6-109c15da0f65 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:52.337277 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG dbcounter [-] [124823] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:52.342627 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-dcd28315-c13c-4ad4-9ee6-109c15da0f65 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:52.344111 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-dcd28315-c13c-4ad4-9ee6-109c15da0f65 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:52.345356 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-dcd28315-c13c-4ad4-9ee6-109c15da0f65 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa" status: 200 len: 1808 microversion: 2.20 time: 0.151181 May 26 12:48:52.346020 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 184/354] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:48:52 2022] GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa => generated 1808 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:48:53.364846 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-fde6200d-b709-4eb0-a6d0-afdd26941501 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:53.365452 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-fde6200d-b709-4eb0-a6d0-afdd26941501 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 7ffbf048-2aa0-4656-a6cd-923b35031eaa] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:53.372087 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-fde6200d-b709-4eb0-a6d0-afdd26941501 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:53.372575 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-fde6200d-b709-4eb0-a6d0-afdd26941501 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:53.373324 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-fde6200d-b709-4eb0-a6d0-afdd26941501 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:53.373772 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-fde6200d-b709-4eb0-a6d0-afdd26941501 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:53.378042 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG dbcounter [-] [124824] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=124824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:53.507225 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-fde6200d-b709-4eb0-a6d0-afdd26941501 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:53.517576 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-fde6200d-b709-4eb0-a6d0-afdd26941501 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:53.519145 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-fde6200d-b709-4eb0-a6d0-afdd26941501 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:53.521412 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-fde6200d-b709-4eb0-a6d0-afdd26941501 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa" status: 200 len: 1808 microversion: 2.20 time: 0.159516 May 26 12:48:53.521412 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 171/355] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:48:53 2022] GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:48:53.725264 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-9ec4c25b-b6a1-4f48-8fd6-556a9f31d780 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "43d93942-6ea0-49b9-9ce8-f169b8dbcccf", "device": "/dev/sdb"}} {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:48:53.727533 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-9ec4c25b-b6a1-4f48-8fd6-556a9f31d780 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] [instance: 9c87b8e9-adf1-40f0-b5d1-6efa2f25ab63] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:53.734348 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-9ec4c25b-b6a1-4f48-8fd6-556a9f31d780 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:53.734794 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-9ec4c25b-b6a1-4f48-8fd6-556a9f31d780 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:53.735553 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-9ec4c25b-b6a1-4f48-8fd6-556a9f31d780 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:53.735985 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-9ec4c25b-b6a1-4f48-8fd6-556a9f31d780 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:54.541986 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-41e71406-d8cd-44c1-bc00-420daba4e10e tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:54.543672 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-41e71406-d8cd-44c1-bc00-420daba4e10e tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 7ffbf048-2aa0-4656-a6cd-923b35031eaa] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:54.552329 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-41e71406-d8cd-44c1-bc00-420daba4e10e tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:54.552867 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-41e71406-d8cd-44c1-bc00-420daba4e10e tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:54.553777 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-41e71406-d8cd-44c1-bc00-420daba4e10e tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:54.554869 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-41e71406-d8cd-44c1-bc00-420daba4e10e tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:54.702203 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-41e71406-d8cd-44c1-bc00-420daba4e10e tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:54.740702 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-41e71406-d8cd-44c1-bc00-420daba4e10e tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:54.742818 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-41e71406-d8cd-44c1-bc00-420daba4e10e tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:54.744007 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-41e71406-d8cd-44c1-bc00-420daba4e10e tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa" status: 200 len: 1808 microversion: 2.20 time: 0.207271 May 26 12:48:54.744749 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 172/356] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:48:54 2022] GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa => generated 1808 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:48:55.763657 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-d5d3dabd-9f52-404e-ad59-83f01f387a15 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:55.764397 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-d5d3dabd-9f52-404e-ad59-83f01f387a15 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 7ffbf048-2aa0-4656-a6cd-923b35031eaa] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:55.772957 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-d5d3dabd-9f52-404e-ad59-83f01f387a15 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:55.773596 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-d5d3dabd-9f52-404e-ad59-83f01f387a15 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:55.774665 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-d5d3dabd-9f52-404e-ad59-83f01f387a15 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:55.775244 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-d5d3dabd-9f52-404e-ad59-83f01f387a15 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:55.942776 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-d5d3dabd-9f52-404e-ad59-83f01f387a15 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:55.953887 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-d5d3dabd-9f52-404e-ad59-83f01f387a15 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:55.958880 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-d5d3dabd-9f52-404e-ad59-83f01f387a15 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:55.958880 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-d5d3dabd-9f52-404e-ad59-83f01f387a15 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa" status: 200 len: 1808 microversion: 2.20 time: 0.199298 May 26 12:48:55.960011 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 173/357] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:48:55 2022] GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa => generated 1808 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:48:56.978223 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-687b6382-2b0f-46ae-9a68-166a884dcdf6 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:56.978977 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-687b6382-2b0f-46ae-9a68-166a884dcdf6 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 7ffbf048-2aa0-4656-a6cd-923b35031eaa] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:56.985756 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-687b6382-2b0f-46ae-9a68-166a884dcdf6 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:56.986275 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-687b6382-2b0f-46ae-9a68-166a884dcdf6 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:56.987123 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-687b6382-2b0f-46ae-9a68-166a884dcdf6 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:56.987561 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-687b6382-2b0f-46ae-9a68-166a884dcdf6 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:57.348422 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-687b6382-2b0f-46ae-9a68-166a884dcdf6 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:57.361425 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-687b6382-2b0f-46ae-9a68-166a884dcdf6 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:57.363077 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-687b6382-2b0f-46ae-9a68-166a884dcdf6 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:57.364403 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-687b6382-2b0f-46ae-9a68-166a884dcdf6 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa" status: 200 len: 1808 microversion: 2.20 time: 0.391095 May 26 12:48:57.365068 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 174/358] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:48:56 2022] GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa => generated 1808 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:48:58.443506 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-8c4fc740-0c70-469e-a035-7bb0b8f279fa tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:58.445566 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-8c4fc740-0c70-469e-a035-7bb0b8f279fa tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 7ffbf048-2aa0-4656-a6cd-923b35031eaa] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:58.453888 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-8c4fc740-0c70-469e-a035-7bb0b8f279fa tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:58.454703 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-8c4fc740-0c70-469e-a035-7bb0b8f279fa tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:58.455668 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-8c4fc740-0c70-469e-a035-7bb0b8f279fa tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:58.456546 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-8c4fc740-0c70-469e-a035-7bb0b8f279fa tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:58.597336 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-8c4fc740-0c70-469e-a035-7bb0b8f279fa tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:58.606488 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-8c4fc740-0c70-469e-a035-7bb0b8f279fa tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:58.607978 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-8c4fc740-0c70-469e-a035-7bb0b8f279fa tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:58.609151 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-8c4fc740-0c70-469e-a035-7bb0b8f279fa tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa" status: 200 len: 1808 microversion: 2.20 time: 0.170280 May 26 12:48:58.609734 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 175/359] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:48:58 2022] GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:48:59.632945 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-e4eca132-123e-49b6-995c-b5c1d1bfd676 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:48:59.632945 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-e4eca132-123e-49b6-995c-b5c1d1bfd676 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 7ffbf048-2aa0-4656-a6cd-923b35031eaa] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:48:59.635124 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG dbcounter [-] [124824] Writing DB stats nova_api:SELECT=66 {{(pid=124824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:59.640188 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-e4eca132-123e-49b6-995c-b5c1d1bfd676 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:59.640632 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-e4eca132-123e-49b6-995c-b5c1d1bfd676 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:59.641456 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-e4eca132-123e-49b6-995c-b5c1d1bfd676 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:48:59.642059 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-e4eca132-123e-49b6-995c-b5c1d1bfd676 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:48:59.779310 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-e4eca132-123e-49b6-995c-b5c1d1bfd676 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:59.787720 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-e4eca132-123e-49b6-995c-b5c1d1bfd676 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:59.789409 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-e4eca132-123e-49b6-995c-b5c1d1bfd676 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:48:59.790601 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-e4eca132-123e-49b6-995c-b5c1d1bfd676 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa" status: 200 len: 1808 microversion: 2.20 time: 0.164607 May 26 12:48:59.791160 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 176/360] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:48:59 2022] GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:49:00.810892 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-414e8e00-cd2b-4df6-a718-3006c117502a tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:00.811639 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-414e8e00-cd2b-4df6-a718-3006c117502a tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 7ffbf048-2aa0-4656-a6cd-923b35031eaa] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:00.818283 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-414e8e00-cd2b-4df6-a718-3006c117502a tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:00.818736 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-414e8e00-cd2b-4df6-a718-3006c117502a tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:00.819514 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-414e8e00-cd2b-4df6-a718-3006c117502a tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:00.819979 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-414e8e00-cd2b-4df6-a718-3006c117502a tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:00.953415 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-414e8e00-cd2b-4df6-a718-3006c117502a tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:00.963725 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-414e8e00-cd2b-4df6-a718-3006c117502a tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:00.964715 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-414e8e00-cd2b-4df6-a718-3006c117502a tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:00.965984 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-414e8e00-cd2b-4df6-a718-3006c117502a tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa" status: 200 len: 1808 microversion: 2.20 time: 0.159032 May 26 12:49:00.966539 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 177/361] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:49:00 2022] GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:49:01.984879 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-0f717ae3-1a01-4daa-952e-53236f432cd9 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:01.985698 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-0f717ae3-1a01-4daa-952e-53236f432cd9 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 7ffbf048-2aa0-4656-a6cd-923b35031eaa] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:01.992914 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-0f717ae3-1a01-4daa-952e-53236f432cd9 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:01.993430 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-0f717ae3-1a01-4daa-952e-53236f432cd9 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:01.994239 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-0f717ae3-1a01-4daa-952e-53236f432cd9 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:01.994679 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-0f717ae3-1a01-4daa-952e-53236f432cd9 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:02.132535 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-0f717ae3-1a01-4daa-952e-53236f432cd9 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:02.141646 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-0f717ae3-1a01-4daa-952e-53236f432cd9 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:02.144639 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-0f717ae3-1a01-4daa-952e-53236f432cd9 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:02.144639 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-0f717ae3-1a01-4daa-952e-53236f432cd9 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa" status: 200 len: 1808 microversion: 2.20 time: 0.163373 May 26 12:49:02.145311 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 178/362] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:49:01 2022] GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:49:03.162611 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-5ab0534a-7813-4edc-bef4-785519f23490 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:03.163459 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-5ab0534a-7813-4edc-bef4-785519f23490 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 7ffbf048-2aa0-4656-a6cd-923b35031eaa] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:03.170715 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-5ab0534a-7813-4edc-bef4-785519f23490 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:03.171158 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-5ab0534a-7813-4edc-bef4-785519f23490 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:03.171921 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-5ab0534a-7813-4edc-bef4-785519f23490 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:03.172581 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-5ab0534a-7813-4edc-bef4-785519f23490 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:03.312745 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-5ab0534a-7813-4edc-bef4-785519f23490 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:03.324374 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-5ab0534a-7813-4edc-bef4-785519f23490 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:03.326027 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-5ab0534a-7813-4edc-bef4-785519f23490 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:03.329516 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-5ab0534a-7813-4edc-bef4-785519f23490 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa" status: 200 len: 1808 microversion: 2.20 time: 0.168812 May 26 12:49:03.329516 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 179/363] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:49:03 2022] GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:49:03.733138 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG dbcounter [-] [124823] Writing DB stats nova_api:SELECT=25 {{(pid=124823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:03.878183 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG dbcounter [-] [124823] Writing DB stats nova_cell1:SELECT=6 {{(pid=124823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:04.347291 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-7993b696-6f86-4c34-adbc-bbeab7e6e163 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:04.347897 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-7993b696-6f86-4c34-adbc-bbeab7e6e163 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 7ffbf048-2aa0-4656-a6cd-923b35031eaa] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:04.354659 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-7993b696-6f86-4c34-adbc-bbeab7e6e163 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:04.355107 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-7993b696-6f86-4c34-adbc-bbeab7e6e163 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:04.355866 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-7993b696-6f86-4c34-adbc-bbeab7e6e163 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:04.356298 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-7993b696-6f86-4c34-adbc-bbeab7e6e163 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:04.496919 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-7993b696-6f86-4c34-adbc-bbeab7e6e163 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:04.508593 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-7993b696-6f86-4c34-adbc-bbeab7e6e163 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:04.510097 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-7993b696-6f86-4c34-adbc-bbeab7e6e163 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:04.511262 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-7993b696-6f86-4c34-adbc-bbeab7e6e163 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa" status: 200 len: 1808 microversion: 2.20 time: 0.167937 May 26 12:49:04.511815 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 180/364] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:49:04 2022] GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:49:05.537622 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-8d30dc4a-04ce-45a8-8544-21ef54201923 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:05.538459 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-8d30dc4a-04ce-45a8-8544-21ef54201923 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 7ffbf048-2aa0-4656-a6cd-923b35031eaa] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:05.554335 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-8d30dc4a-04ce-45a8-8544-21ef54201923 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:05.554787 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-8d30dc4a-04ce-45a8-8544-21ef54201923 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:05.555577 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-8d30dc4a-04ce-45a8-8544-21ef54201923 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:05.556021 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-8d30dc4a-04ce-45a8-8544-21ef54201923 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:05.763247 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-8d30dc4a-04ce-45a8-8544-21ef54201923 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:05.772160 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-8d30dc4a-04ce-45a8-8544-21ef54201923 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:05.774547 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-8d30dc4a-04ce-45a8-8544-21ef54201923 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:05.775728 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-8d30dc4a-04ce-45a8-8544-21ef54201923 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa" status: 200 len: 1808 microversion: 2.20 time: 0.249359 May 26 12:49:05.776677 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 181/365] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:49:05 2022] GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa => generated 1808 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:49:06.191022 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-9ec4c25b-b6a1-4f48-8fd6-556a9f31d780 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] 10.222.0.41 "POST /compute/v2.1/servers/9c87b8e9-adf1-40f0-b5d1-6efa2f25ab63/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 12.469706 May 26 12:49:06.191961 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 185/366] 10.222.0.41 () {60 vars in 1322 bytes} [Thu May 26 12:48:53 2022] POST /compute/v2.1/servers/9c87b8e9-adf1-40f0-b5d1-6efa2f25ab63/os-volume_attachments => generated 194 bytes in 12472 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:49:06.794969 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-c8fe632a-b391-4e64-9094-5bd122ca9ca1 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:06.795665 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-c8fe632a-b391-4e64-9094-5bd122ca9ca1 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 7ffbf048-2aa0-4656-a6cd-923b35031eaa] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:06.802130 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-c8fe632a-b391-4e64-9094-5bd122ca9ca1 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:06.802579 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-c8fe632a-b391-4e64-9094-5bd122ca9ca1 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:06.803340 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-c8fe632a-b391-4e64-9094-5bd122ca9ca1 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:06.803775 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-c8fe632a-b391-4e64-9094-5bd122ca9ca1 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:06.942133 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-c8fe632a-b391-4e64-9094-5bd122ca9ca1 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:06.951025 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-c8fe632a-b391-4e64-9094-5bd122ca9ca1 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:06.952510 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-c8fe632a-b391-4e64-9094-5bd122ca9ca1 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:06.953683 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-c8fe632a-b391-4e64-9094-5bd122ca9ca1 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa" status: 200 len: 1808 microversion: 2.20 time: 0.162715 May 26 12:49:06.954254 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 182/367] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:49:06 2022] GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:49:07.973077 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-4c07a813-e523-4eb0-a79c-ff1dbfeb343b tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:07.973828 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-4c07a813-e523-4eb0-a79c-ff1dbfeb343b tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 7ffbf048-2aa0-4656-a6cd-923b35031eaa] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:07.980684 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-4c07a813-e523-4eb0-a79c-ff1dbfeb343b tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:07.981129 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-4c07a813-e523-4eb0-a79c-ff1dbfeb343b tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:07.981910 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-4c07a813-e523-4eb0-a79c-ff1dbfeb343b tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:07.982337 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-4c07a813-e523-4eb0-a79c-ff1dbfeb343b tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:08.113816 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-4c07a813-e523-4eb0-a79c-ff1dbfeb343b tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:08.122152 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-4c07a813-e523-4eb0-a79c-ff1dbfeb343b tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:08.123639 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-4c07a813-e523-4eb0-a79c-ff1dbfeb343b tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:08.124782 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-4c07a813-e523-4eb0-a79c-ff1dbfeb343b tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa" status: 200 len: 1808 microversion: 2.20 time: 0.156046 May 26 12:49:08.125347 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 186/368] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:49:07 2022] GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:49:09.144255 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-95361f26-8079-4408-aa0a-37cc5148b444 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:09.144792 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-95361f26-8079-4408-aa0a-37cc5148b444 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 7ffbf048-2aa0-4656-a6cd-923b35031eaa] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:09.151863 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-95361f26-8079-4408-aa0a-37cc5148b444 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:09.155518 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-95361f26-8079-4408-aa0a-37cc5148b444 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:09.155518 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-95361f26-8079-4408-aa0a-37cc5148b444 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:09.155518 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-95361f26-8079-4408-aa0a-37cc5148b444 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:09.285931 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-95361f26-8079-4408-aa0a-37cc5148b444 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:09.295355 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-95361f26-8079-4408-aa0a-37cc5148b444 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:09.296844 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-95361f26-8079-4408-aa0a-37cc5148b444 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:09.298036 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-95361f26-8079-4408-aa0a-37cc5148b444 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa" status: 200 len: 1808 microversion: 2.20 time: 0.157729 May 26 12:49:09.298597 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 183/369] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:49:09 2022] GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:49:10.316411 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-49dea8e2-96c7-4587-bd13-6e3e91562f16 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:10.317144 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-49dea8e2-96c7-4587-bd13-6e3e91562f16 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 7ffbf048-2aa0-4656-a6cd-923b35031eaa] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:10.323683 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-49dea8e2-96c7-4587-bd13-6e3e91562f16 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:10.324123 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-49dea8e2-96c7-4587-bd13-6e3e91562f16 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:10.324868 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-49dea8e2-96c7-4587-bd13-6e3e91562f16 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:10.325295 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-49dea8e2-96c7-4587-bd13-6e3e91562f16 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:10.463374 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-49dea8e2-96c7-4587-bd13-6e3e91562f16 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:10.468920 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-49dea8e2-96c7-4587-bd13-6e3e91562f16 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:10.470357 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-49dea8e2-96c7-4587-bd13-6e3e91562f16 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:10.471531 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-49dea8e2-96c7-4587-bd13-6e3e91562f16 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa" status: 200 len: 1808 microversion: 2.20 time: 0.159087 May 26 12:49:10.472087 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 187/370] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:49:10 2022] GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:49:11.491030 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-d7768abc-1481-4086-a7bf-203d6da0d80f tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:11.495863 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-d7768abc-1481-4086-a7bf-203d6da0d80f tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 7ffbf048-2aa0-4656-a6cd-923b35031eaa] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:11.498397 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-d7768abc-1481-4086-a7bf-203d6da0d80f tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:11.498846 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-d7768abc-1481-4086-a7bf-203d6da0d80f tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:11.499611 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-d7768abc-1481-4086-a7bf-203d6da0d80f tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:11.500065 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-d7768abc-1481-4086-a7bf-203d6da0d80f tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:11.626688 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-d7768abc-1481-4086-a7bf-203d6da0d80f tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:11.635820 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-d7768abc-1481-4086-a7bf-203d6da0d80f tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:11.637314 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-d7768abc-1481-4086-a7bf-203d6da0d80f tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:11.638503 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-d7768abc-1481-4086-a7bf-203d6da0d80f tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa" status: 200 len: 1808 microversion: 2.20 time: 0.151635 May 26 12:49:11.639295 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 184/371] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:49:11 2022] GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:49:12.656857 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-db3104c0-954a-454f-bde6-4a1766b7da55 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:12.657458 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-db3104c0-954a-454f-bde6-4a1766b7da55 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 7ffbf048-2aa0-4656-a6cd-923b35031eaa] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:12.663843 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-db3104c0-954a-454f-bde6-4a1766b7da55 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:12.664284 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-db3104c0-954a-454f-bde6-4a1766b7da55 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:12.665030 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-db3104c0-954a-454f-bde6-4a1766b7da55 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:12.665459 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-db3104c0-954a-454f-bde6-4a1766b7da55 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:12.789580 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-db3104c0-954a-454f-bde6-4a1766b7da55 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:12.798040 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-db3104c0-954a-454f-bde6-4a1766b7da55 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:12.799551 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-db3104c0-954a-454f-bde6-4a1766b7da55 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:12.800716 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-db3104c0-954a-454f-bde6-4a1766b7da55 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa" status: 200 len: 1808 microversion: 2.20 time: 0.147788 May 26 12:49:12.801285 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 188/372] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:49:12 2022] GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa => generated 1808 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:49:13.819431 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-7d889e69-3362-4826-b752-25c0f664a228 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:13.820032 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-7d889e69-3362-4826-b752-25c0f664a228 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 7ffbf048-2aa0-4656-a6cd-923b35031eaa] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:13.827033 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-7d889e69-3362-4826-b752-25c0f664a228 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:13.827482 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-7d889e69-3362-4826-b752-25c0f664a228 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:13.828240 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-7d889e69-3362-4826-b752-25c0f664a228 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:13.828672 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-7d889e69-3362-4826-b752-25c0f664a228 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:13.956932 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-7d889e69-3362-4826-b752-25c0f664a228 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:13.965867 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-7d889e69-3362-4826-b752-25c0f664a228 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:13.967350 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-7d889e69-3362-4826-b752-25c0f664a228 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:13.968495 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-7d889e69-3362-4826-b752-25c0f664a228 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa" status: 200 len: 1808 microversion: 2.20 time: 0.153184 May 26 12:49:13.969152 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 185/373] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:49:13 2022] GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:49:14.987591 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-553d3f5b-bf04-4930-ac77-716cca4aed64 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:14.988201 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-553d3f5b-bf04-4930-ac77-716cca4aed64 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 7ffbf048-2aa0-4656-a6cd-923b35031eaa] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:14.995216 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-553d3f5b-bf04-4930-ac77-716cca4aed64 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:14.995665 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-553d3f5b-bf04-4930-ac77-716cca4aed64 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:14.996430 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-553d3f5b-bf04-4930-ac77-716cca4aed64 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:14.996860 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-553d3f5b-bf04-4930-ac77-716cca4aed64 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:15.130280 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-553d3f5b-bf04-4930-ac77-716cca4aed64 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:15.138714 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-553d3f5b-bf04-4930-ac77-716cca4aed64 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:15.140215 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-553d3f5b-bf04-4930-ac77-716cca4aed64 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:15.141366 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-553d3f5b-bf04-4930-ac77-716cca4aed64 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa" status: 200 len: 1808 microversion: 2.20 time: 0.157784 May 26 12:49:15.142109 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 189/374] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:49:14 2022] GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:49:16.160232 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-4c382a42-9cf7-4996-98d2-4b6830df4d75 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:16.160865 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-4c382a42-9cf7-4996-98d2-4b6830df4d75 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 7ffbf048-2aa0-4656-a6cd-923b35031eaa] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:16.168023 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-4c382a42-9cf7-4996-98d2-4b6830df4d75 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:16.168470 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-4c382a42-9cf7-4996-98d2-4b6830df4d75 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:16.169235 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-4c382a42-9cf7-4996-98d2-4b6830df4d75 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:16.169683 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-4c382a42-9cf7-4996-98d2-4b6830df4d75 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:16.305445 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-4c382a42-9cf7-4996-98d2-4b6830df4d75 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:16.313933 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-4c382a42-9cf7-4996-98d2-4b6830df4d75 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:16.315470 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-4c382a42-9cf7-4996-98d2-4b6830df4d75 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:16.316613 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-4c382a42-9cf7-4996-98d2-4b6830df4d75 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa" status: 200 len: 1808 microversion: 2.20 time: 0.160218 May 26 12:49:16.317173 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 186/375] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:49:16 2022] GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:49:16.624191 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [req-7d926665-2551-4fc4-b5a0-c9fed728efd3 req-99dcb852-272e-4117-86b5-695ee25968a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ffbf048-2aa0-4656-a6cd-923b35031eaa", "name": "network-vif-plugged", "status": "completed", "tag": "979ef417-a463-49c2-a7ae-7fae04d77dd9"}]} {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:49:16.632897 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [req-7d926665-2551-4fc4-b5a0-c9fed728efd3 req-99dcb852-272e-4117-86b5-695ee25968a6 service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:16.636654 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [req-7d926665-2551-4fc4-b5a0-c9fed728efd3 req-99dcb852-272e-4117-86b5-695ee25968a6 service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:16.644076 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.compute.server_external_events [req-7d926665-2551-4fc4-b5a0-c9fed728efd3 req-99dcb852-272e-4117-86b5-695ee25968a6 service nova] Creating event network-vif-plugged:979ef417-a463-49c2-a7ae-7fae04d77dd9 for instance 7ffbf048-2aa0-4656-a6cd-923b35031eaa on hv-cinder-81571 May 26 12:49:16.649600 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [req-7d926665-2551-4fc4-b5a0-c9fed728efd3 req-99dcb852-272e-4117-86b5-695ee25968a6 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029075 May 26 12:49:16.650292 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 190/376] 10.222.0.41 () {64 vars in 1317 bytes} [Thu May 26 12:49:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:49:17.334683 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-18fabc11-bc9d-488f-b682-61cef63b2c61 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:17.335757 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-18fabc11-bc9d-488f-b682-61cef63b2c61 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 7ffbf048-2aa0-4656-a6cd-923b35031eaa] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:17.342213 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-18fabc11-bc9d-488f-b682-61cef63b2c61 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:17.342699 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-18fabc11-bc9d-488f-b682-61cef63b2c61 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:17.343425 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-18fabc11-bc9d-488f-b682-61cef63b2c61 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:17.343861 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-18fabc11-bc9d-488f-b682-61cef63b2c61 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:17.514972 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-18fabc11-bc9d-488f-b682-61cef63b2c61 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:17.517194 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG dbcounter [-] [124824] Writing DB stats nova_cell1:SELECT=100 {{(pid=124824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:17.524582 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-18fabc11-bc9d-488f-b682-61cef63b2c61 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:17.526460 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-18fabc11-bc9d-488f-b682-61cef63b2c61 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:17.527659 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-18fabc11-bc9d-488f-b682-61cef63b2c61 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa" status: 200 len: 1808 microversion: 2.20 time: 0.197081 May 26 12:49:17.528287 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 187/377] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:49:17 2022] GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa => generated 1808 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:49:18.547067 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-dd7d6633-49e8-4bdd-acae-831a0579f6ba tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:18.547759 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-dd7d6633-49e8-4bdd-acae-831a0579f6ba tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 7ffbf048-2aa0-4656-a6cd-923b35031eaa] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:18.554564 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-dd7d6633-49e8-4bdd-acae-831a0579f6ba tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:18.554996 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-dd7d6633-49e8-4bdd-acae-831a0579f6ba tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:18.555757 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-dd7d6633-49e8-4bdd-acae-831a0579f6ba tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:18.556191 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-dd7d6633-49e8-4bdd-acae-831a0579f6ba tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:18.681971 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-dd7d6633-49e8-4bdd-acae-831a0579f6ba tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:18.690579 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-dd7d6633-49e8-4bdd-acae-831a0579f6ba tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:18.691997 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-dd7d6633-49e8-4bdd-acae-831a0579f6ba tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:18.693138 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-dd7d6633-49e8-4bdd-acae-831a0579f6ba tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa" status: 200 len: 1808 microversion: 2.20 time: 0.150955 May 26 12:49:18.693894 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 191/378] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:49:18 2022] GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa => generated 1808 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:49:19.712028 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-1c126026-6e3f-4b4a-b36c-11eb5fd4cec0 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:19.712686 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-1c126026-6e3f-4b4a-b36c-11eb5fd4cec0 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 7ffbf048-2aa0-4656-a6cd-923b35031eaa] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:19.719548 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-1c126026-6e3f-4b4a-b36c-11eb5fd4cec0 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:19.719993 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-1c126026-6e3f-4b4a-b36c-11eb5fd4cec0 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:19.720750 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-1c126026-6e3f-4b4a-b36c-11eb5fd4cec0 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:19.721181 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-1c126026-6e3f-4b4a-b36c-11eb5fd4cec0 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:19.848184 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-1c126026-6e3f-4b4a-b36c-11eb5fd4cec0 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:19.857351 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-1c126026-6e3f-4b4a-b36c-11eb5fd4cec0 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:19.858874 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-1c126026-6e3f-4b4a-b36c-11eb5fd4cec0 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:19.860033 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-1c126026-6e3f-4b4a-b36c-11eb5fd4cec0 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa" status: 200 len: 1808 microversion: 2.20 time: 0.152436 May 26 12:49:19.860597 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 188/379] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:49:19 2022] GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:49:20.877993 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-6fd8d39a-45ff-46cc-9e08-8136424ba605 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:20.878639 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-6fd8d39a-45ff-46cc-9e08-8136424ba605 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 7ffbf048-2aa0-4656-a6cd-923b35031eaa] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:20.885118 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-6fd8d39a-45ff-46cc-9e08-8136424ba605 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:20.885562 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-6fd8d39a-45ff-46cc-9e08-8136424ba605 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:20.886355 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-6fd8d39a-45ff-46cc-9e08-8136424ba605 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:20.886784 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-6fd8d39a-45ff-46cc-9e08-8136424ba605 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:21.017973 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-6fd8d39a-45ff-46cc-9e08-8136424ba605 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:21.027216 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-6fd8d39a-45ff-46cc-9e08-8136424ba605 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:21.028836 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-6fd8d39a-45ff-46cc-9e08-8136424ba605 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:21.030072 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-6fd8d39a-45ff-46cc-9e08-8136424ba605 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa" status: 200 len: 1808 microversion: 2.20 time: 0.156019 May 26 12:49:21.030632 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 192/380] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:49:20 2022] GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:49:22.049248 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-0b13cc2e-5669-4122-b274-5e5e03daefb0 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:22.049904 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-0b13cc2e-5669-4122-b274-5e5e03daefb0 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 7ffbf048-2aa0-4656-a6cd-923b35031eaa] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:22.056849 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-0b13cc2e-5669-4122-b274-5e5e03daefb0 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:22.057290 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-0b13cc2e-5669-4122-b274-5e5e03daefb0 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:22.058087 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-0b13cc2e-5669-4122-b274-5e5e03daefb0 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:22.058520 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-0b13cc2e-5669-4122-b274-5e5e03daefb0 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:22.198365 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-0b13cc2e-5669-4122-b274-5e5e03daefb0 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:22.208048 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-0b13cc2e-5669-4122-b274-5e5e03daefb0 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:22.209562 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-0b13cc2e-5669-4122-b274-5e5e03daefb0 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:22.210799 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-0b13cc2e-5669-4122-b274-5e5e03daefb0 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa" status: 200 len: 1808 microversion: 2.20 time: 0.165583 May 26 12:49:22.211361 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 189/381] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:49:22 2022] GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:49:23.229785 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-3fee4f8d-2c5a-4362-b4e4-606c85ca89f9 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:23.230447 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-3fee4f8d-2c5a-4362-b4e4-606c85ca89f9 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 7ffbf048-2aa0-4656-a6cd-923b35031eaa] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:23.237101 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-3fee4f8d-2c5a-4362-b4e4-606c85ca89f9 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:23.237558 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-3fee4f8d-2c5a-4362-b4e4-606c85ca89f9 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:23.238359 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-3fee4f8d-2c5a-4362-b4e4-606c85ca89f9 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:23.238781 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-3fee4f8d-2c5a-4362-b4e4-606c85ca89f9 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:23.368163 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-3fee4f8d-2c5a-4362-b4e4-606c85ca89f9 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:23.377095 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-3fee4f8d-2c5a-4362-b4e4-606c85ca89f9 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:23.378751 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-3fee4f8d-2c5a-4362-b4e4-606c85ca89f9 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:23.379799 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-3fee4f8d-2c5a-4362-b4e4-606c85ca89f9 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa" status: 200 len: 1808 microversion: 2.20 time: 0.154679 May 26 12:49:23.380469 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 193/382] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:49:23 2022] GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:49:24.403305 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-9ee32fe8-59b0-42bb-a78f-e38771739384 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:24.403874 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-9ee32fe8-59b0-42bb-a78f-e38771739384 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 7ffbf048-2aa0-4656-a6cd-923b35031eaa] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:24.411010 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-9ee32fe8-59b0-42bb-a78f-e38771739384 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:24.411454 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-9ee32fe8-59b0-42bb-a78f-e38771739384 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:24.412405 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-9ee32fe8-59b0-42bb-a78f-e38771739384 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:24.412630 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-9ee32fe8-59b0-42bb-a78f-e38771739384 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:24.543219 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-9ee32fe8-59b0-42bb-a78f-e38771739384 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:24.552451 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-9ee32fe8-59b0-42bb-a78f-e38771739384 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:24.554002 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-9ee32fe8-59b0-42bb-a78f-e38771739384 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:24.555664 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-9ee32fe8-59b0-42bb-a78f-e38771739384 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa" status: 200 len: 1808 microversion: 2.20 time: 0.156969 May 26 12:49:24.556292 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 190/383] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:49:24 2022] GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:49:25.573933 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-91b22c8a-5f98-41f1-82b7-40225506b86d tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:25.574550 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-91b22c8a-5f98-41f1-82b7-40225506b86d tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 7ffbf048-2aa0-4656-a6cd-923b35031eaa] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:25.581181 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-91b22c8a-5f98-41f1-82b7-40225506b86d tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:25.581629 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-91b22c8a-5f98-41f1-82b7-40225506b86d tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:25.582423 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-91b22c8a-5f98-41f1-82b7-40225506b86d tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:25.582891 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-91b22c8a-5f98-41f1-82b7-40225506b86d tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:25.717209 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-91b22c8a-5f98-41f1-82b7-40225506b86d tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:25.726272 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-91b22c8a-5f98-41f1-82b7-40225506b86d tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:25.728355 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-91b22c8a-5f98-41f1-82b7-40225506b86d tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:25.729515 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-91b22c8a-5f98-41f1-82b7-40225506b86d tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa" status: 200 len: 1795 microversion: 2.20 time: 0.159681 May 26 12:49:25.730101 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 194/384] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:49:25 2022] GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa => generated 1795 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:49:34.260075 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-e58005bc-6c4e-413e-8501-fc8a9440fc3c tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:34.260596 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-e58005bc-6c4e-413e-8501-fc8a9440fc3c tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] [instance: 9c87b8e9-adf1-40f0-b5d1-6efa2f25ab63] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:34.263082 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG dbcounter [-] [124824] Writing DB stats nova_api:SELECT=30 {{(pid=124824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:34.268030 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-e58005bc-6c4e-413e-8501-fc8a9440fc3c tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:34.268472 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-e58005bc-6c4e-413e-8501-fc8a9440fc3c tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:34.269226 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-e58005bc-6c4e-413e-8501-fc8a9440fc3c tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:34.269682 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-e58005bc-6c4e-413e-8501-fc8a9440fc3c tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:34.405087 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.objects.instance [None req-e58005bc-6c4e-413e-8501-fc8a9440fc3c tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lazy-loading 'services' on Instance uuid 9c87b8e9-adf1-40f0-b5d1-6efa2f25ab63 {{(pid=124824) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:49:34.711549 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-e58005bc-6c4e-413e-8501-fc8a9440fc3c tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] 10.222.0.41 "DELETE /compute/v2.1/servers/9c87b8e9-adf1-40f0-b5d1-6efa2f25ab63/os-volume_attachments/43d93942-6ea0-49b9-9ce8-f169b8dbcccf" status: 202 len: 0 microversion: 2.1 time: 0.455001 May 26 12:49:34.712167 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 191/385] 10.222.0.41 () {58 vars in 1415 bytes} [Thu May 26 12:49:34 2022] DELETE /compute/v2.1/servers/9c87b8e9-adf1-40f0-b5d1-6efa2f25ab63/os-volume_attachments/43d93942-6ea0-49b9-9ce8-f169b8dbcccf => generated 0 bytes in 457 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 12:49:36.892673 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-17fecf00-cdce-41ed-99ed-b28dcd9a71da tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:36.893190 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-17fecf00-cdce-41ed-99ed-b28dcd9a71da tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] [instance: 9c87b8e9-adf1-40f0-b5d1-6efa2f25ab63] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:36.896010 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG dbcounter [-] [124823] Writing DB stats nova_api:SELECT=18 {{(pid=124823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:36.896751 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG dbcounter [-] [124823] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:36.901475 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-17fecf00-cdce-41ed-99ed-b28dcd9a71da tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:36.909258 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-17fecf00-cdce-41ed-99ed-b28dcd9a71da tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:36.909258 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-17fecf00-cdce-41ed-99ed-b28dcd9a71da tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:36.909258 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-17fecf00-cdce-41ed-99ed-b28dcd9a71da tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:36.929118 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-17fecf00-cdce-41ed-99ed-b28dcd9a71da tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] [instance: 9c87b8e9-adf1-40f0-b5d1-6efa2f25ab63] Going to try to terminate instance {{(pid=124823) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 12:49:37.306236 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-17fecf00-cdce-41ed-99ed-b28dcd9a71da tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] 10.222.0.41 "DELETE /compute/v2.1/servers/9c87b8e9-adf1-40f0-b5d1-6efa2f25ab63" status: 204 len: 0 microversion: 2.1 time: 0.417139 May 26 12:49:37.306952 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 195/386] 10.222.0.41 () {58 vars in 1238 bytes} [Thu May 26 12:49:36 2022] DELETE /compute/v2.1/servers/9c87b8e9-adf1-40f0-b5d1-6efa2f25ab63 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 12:49:37.316066 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-192da35b-2cb2-435c-80b6-b4558858adaa tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:37.319088 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-192da35b-2cb2-435c-80b6-b4558858adaa tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] [instance: 9c87b8e9-adf1-40f0-b5d1-6efa2f25ab63] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:37.323030 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-192da35b-2cb2-435c-80b6-b4558858adaa tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:37.323471 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-192da35b-2cb2-435c-80b6-b4558858adaa tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:37.324219 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-192da35b-2cb2-435c-80b6-b4558858adaa tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:37.324643 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-192da35b-2cb2-435c-80b6-b4558858adaa tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:37.460349 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-192da35b-2cb2-435c-80b6-b4558858adaa tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646a9abb1f9d4a1295a04defd895ff7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd539dfec943a44eb9b025d842a1f858d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:37.467741 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-192da35b-2cb2-435c-80b6-b4558858adaa tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] 10.222.0.41 "GET /compute/v2.1/servers/9c87b8e9-adf1-40f0-b5d1-6efa2f25ab63" status: 200 len: 1513 microversion: 2.1 time: 0.156481 May 26 12:49:37.468314 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 192/387] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:49:37 2022] GET /compute/v2.1/servers/9c87b8e9-adf1-40f0-b5d1-6efa2f25ab63 => generated 1513 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:49:38.486450 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-0110c7d6-bcb6-4456-b6bd-0cdd121fca8c tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:38.487161 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-0110c7d6-bcb6-4456-b6bd-0cdd121fca8c tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] [instance: 9c87b8e9-adf1-40f0-b5d1-6efa2f25ab63] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:38.494292 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-0110c7d6-bcb6-4456-b6bd-0cdd121fca8c tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:38.494742 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-0110c7d6-bcb6-4456-b6bd-0cdd121fca8c tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:38.495509 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-0110c7d6-bcb6-4456-b6bd-0cdd121fca8c tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:38.495947 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-0110c7d6-bcb6-4456-b6bd-0cdd121fca8c tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:38.621713 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-0110c7d6-bcb6-4456-b6bd-0cdd121fca8c tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646a9abb1f9d4a1295a04defd895ff7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd539dfec943a44eb9b025d842a1f858d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:38.629216 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-0110c7d6-bcb6-4456-b6bd-0cdd121fca8c tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] 10.222.0.41 "GET /compute/v2.1/servers/9c87b8e9-adf1-40f0-b5d1-6efa2f25ab63" status: 200 len: 1513 microversion: 2.1 time: 0.147070 May 26 12:49:38.629804 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 196/388] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:49:38 2022] GET /compute/v2.1/servers/9c87b8e9-adf1-40f0-b5d1-6efa2f25ab63 => generated 1513 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:49:39.646208 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-b627c91c-7bbe-4596-aa13-58e859a73092 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:39.646862 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-b627c91c-7bbe-4596-aa13-58e859a73092 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] [instance: 9c87b8e9-adf1-40f0-b5d1-6efa2f25ab63] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:39.653420 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-b627c91c-7bbe-4596-aa13-58e859a73092 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:39.653891 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-b627c91c-7bbe-4596-aa13-58e859a73092 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:39.654656 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-b627c91c-7bbe-4596-aa13-58e859a73092 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:39.655112 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-b627c91c-7bbe-4596-aa13-58e859a73092 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:39.913646 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-b627c91c-7bbe-4596-aa13-58e859a73092 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646a9abb1f9d4a1295a04defd895ff7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd539dfec943a44eb9b025d842a1f858d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:39.921575 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-b627c91c-7bbe-4596-aa13-58e859a73092 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] 10.222.0.41 "GET /compute/v2.1/servers/9c87b8e9-adf1-40f0-b5d1-6efa2f25ab63" status: 200 len: 1513 microversion: 2.1 time: 0.279199 May 26 12:49:39.922182 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 193/389] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:49:39 2022] GET /compute/v2.1/servers/9c87b8e9-adf1-40f0-b5d1-6efa2f25ab63 => generated 1513 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:49:40.385179 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [req-a357f128-4cdb-4d62-9a6c-89a8b17cfe10 req-416215a4-94ef-41b9-9d73-8edbbfa35ad3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c87b8e9-adf1-40f0-b5d1-6efa2f25ab63", "name": "network-vif-deleted", "tag": "d06501d9-6a97-4277-a1d1-1171ea317203"}]} {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:49:40.394057 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [req-a357f128-4cdb-4d62-9a6c-89a8b17cfe10 req-416215a4-94ef-41b9-9d73-8edbbfa35ad3 service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:40.394501 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [req-a357f128-4cdb-4d62-9a6c-89a8b17cfe10 req-416215a4-94ef-41b9-9d73-8edbbfa35ad3 service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:40.410141 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.compute.server_external_events [req-a357f128-4cdb-4d62-9a6c-89a8b17cfe10 req-416215a4-94ef-41b9-9d73-8edbbfa35ad3 service nova] Creating event network-vif-deleted:d06501d9-6a97-4277-a1d1-1171ea317203 for instance 9c87b8e9-adf1-40f0-b5d1-6efa2f25ab63 on hv-cinder-81571 May 26 12:49:40.415783 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [req-a357f128-4cdb-4d62-9a6c-89a8b17cfe10 req-416215a4-94ef-41b9-9d73-8edbbfa35ad3 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036193 May 26 12:49:40.416452 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 197/390] 10.222.0.41 () {64 vars in 1317 bytes} [Thu May 26 12:49:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:49:40.938420 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-438693c8-3b9f-4cc5-9131-2b349c2f8844 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:40.939141 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-438693c8-3b9f-4cc5-9131-2b349c2f8844 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] [instance: 9c87b8e9-adf1-40f0-b5d1-6efa2f25ab63] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:40.945118 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-438693c8-3b9f-4cc5-9131-2b349c2f8844 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:40.945558 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-438693c8-3b9f-4cc5-9131-2b349c2f8844 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:40.946987 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-438693c8-3b9f-4cc5-9131-2b349c2f8844 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:40.947419 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-438693c8-3b9f-4cc5-9131-2b349c2f8844 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:40.977294 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-438693c8-3b9f-4cc5-9131-2b349c2f8844 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:40.977750 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-438693c8-3b9f-4cc5-9131-2b349c2f8844 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:40.978217 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.objects.instance [None req-438693c8-3b9f-4cc5-9131-2b349c2f8844 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lazy-loading 'fault' on Instance uuid 9c87b8e9-adf1-40f0-b5d1-6efa2f25ab63 {{(pid=124824) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:49:41.019355 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-438693c8-3b9f-4cc5-9131-2b349c2f8844 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646a9abb1f9d4a1295a04defd895ff7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd539dfec943a44eb9b025d842a1f858d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:41.027266 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-438693c8-3b9f-4cc5-9131-2b349c2f8844 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] 10.222.0.41 "GET /compute/v2.1/servers/9c87b8e9-adf1-40f0-b5d1-6efa2f25ab63" status: 200 len: 1308 microversion: 2.1 time: 0.092747 May 26 12:49:41.031715 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 194/391] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:49:40 2022] GET /compute/v2.1/servers/9c87b8e9-adf1-40f0-b5d1-6efa2f25ab63 => generated 1308 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:49:42.044907 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-a073ac07-8667-4fe1-a8a0-6505aec45407 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:42.045606 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-a073ac07-8667-4fe1-a8a0-6505aec45407 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] [instance: 9c87b8e9-adf1-40f0-b5d1-6efa2f25ab63] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:42.052696 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-a073ac07-8667-4fe1-a8a0-6505aec45407 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:42.053140 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-a073ac07-8667-4fe1-a8a0-6505aec45407 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:42.053934 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-a073ac07-8667-4fe1-a8a0-6505aec45407 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:42.054368 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-a073ac07-8667-4fe1-a8a0-6505aec45407 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:42.067188 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.wsgi [None req-a073ac07-8667-4fe1-a8a0-6505aec45407 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] HTTP exception thrown: Instance 9c87b8e9-adf1-40f0-b5d1-6efa2f25ab63 could not be found. May 26 12:49:42.068929 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-a073ac07-8667-4fe1-a8a0-6505aec45407 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Request method failure captured: May 26 12:49:42.068929 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: request: GET /compute/v2.1/servers/9c87b8e9-adf1-40f0-b5d1-6efa2f25ab63 HTTP/1.1 May 26 12:49:42.068929 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Accept: application/json May 26 12:49:42.068929 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Accept-Encoding: identity May 26 12:49:42.068929 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Connection: close May 26 12:49:42.068929 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Content-Length: 0 May 26 12:49:42.068929 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Content-Type: application/json May 26 12:49:42.068929 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Host: 10.222.0.41 May 26 12:49:42.068929 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Openstack-System-Scope: None May 26 12:49:42.068929 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: User-Agent: python-urllib3/1.26.9 May 26 12:49:42.068929 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Auth-Token: gAAAAABij3cLuxa3iBFkQynmTv9WriK4EgE9beFjBLMZ8d4bdD4k8a0ptpwAH2NN8n4K1nsFpNLs84sh6G0PBMtH3yF9Q0ynab-1NYFN5tv2enSQ0eEX1TFE87MKUp-sUK6gGTxgIB62qh1zuYspXmNMpyQrvHBgqO2x_-GRG_xVxQT13jdcAzM May 26 12:49:42.068929 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Domain-Id: None May 26 12:49:42.068929 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Domain-Name: None May 26 12:49:42.068929 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Identity-Status: Confirmed May 26 12:49:42.068929 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Is-Admin-Project: True May 26 12:49:42.068929 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Project-Domain-Id: default May 26 12:49:42.068929 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Project-Domain-Name: Default May 26 12:49:42.068929 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Project-Id: d539dfec943a44eb9b025d842a1f858d May 26 12:49:42.068929 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Project-Name: tempest-VolumesSnapshotTestJSON-601418415 May 26 12:49:42.068929 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Role: member,reader May 26 12:49:42.068929 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Roles: member,reader May 26 12:49:42.076814 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/d539dfec943a44eb9b025d842a1f858d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/d539dfec943a44eb9b025d842a1f858d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/d539dfec943a44eb9b025d842a1f858d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_d539dfec943a44eb9b025d842a1f858d", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 26 12:49:42.076814 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Tenant: tempest-VolumesSnapshotTestJSON-601418415 May 26 12:49:42.076814 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Tenant-Id: d539dfec943a44eb9b025d842a1f858d May 26 12:49:42.076814 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-601418415 May 26 12:49:42.076814 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User: tempest-VolumesSnapshotTestJSON-601418415-project May 26 12:49:42.076814 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User-Domain-Id: default May 26 12:49:42.076814 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User-Domain-Name: Default May 26 12:49:42.076814 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User-Id: 646a9abb1f9d4a1295a04defd895ff7c May 26 12:49:42.076814 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User-Name: tempest-VolumesSnapshotTestJSON-601418415-project May 26 12:49:42.076814 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: method: > May 26 12:49:42.076814 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: exception: Instance 9c87b8e9-adf1-40f0-b5d1-6efa2f25ab63 could not be found. May 26 12:49:42.076814 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: action_args: {'id': '9c87b8e9-adf1-40f0-b5d1-6efa2f25ab63'} May 26 12:49:42.077576 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:49:42.077576 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:49:42.077576 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:49:42.077576 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:49:42.077576 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:49:42.077576 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:49:42.077576 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:49:42.077576 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:49:42.077576 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:49:42.077576 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:49:42.077576 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c87b8e9-adf1-40f0-b5d1-6efa2f25ab63 could not be found. May 26 12:49:42.077576 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:49:42.077576 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:49:42.077576 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:49:42.077576 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:49:42.077576 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:49:42.077576 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:49:42.077576 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:49:42.077576 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:49:42.077576 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:49:42.078792 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:49:42.078792 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 12:49:42.078792 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 12:49:42.078792 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:49:42.078792 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:49:42.078792 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:49:42.078792 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:49:42.078792 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c87b8e9-adf1-40f0-b5d1-6efa2f25ab63 could not be found. May 26 12:49:42.078792 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:49:42.078792 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:49:42.078792 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:49:42.078792 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:49:42.078792 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:49:42.078792 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:49:42.078792 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:49:42.078792 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:49:42.078792 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c87b8e9-adf1-40f0-b5d1-6efa2f25ab63 could not be found. May 26 12:49:42.078792 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:49:42.079820 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-a073ac07-8667-4fe1-a8a0-6505aec45407 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Returning 404 to user: Instance 9c87b8e9-adf1-40f0-b5d1-6efa2f25ab63 could not be found. {{(pid=124823) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:49:42.079820 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-a073ac07-8667-4fe1-a8a0-6505aec45407 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] 10.222.0.41 "GET /compute/v2.1/servers/9c87b8e9-adf1-40f0-b5d1-6efa2f25ab63" status: 404 len: 111 microversion: 2.1 time: 0.030126 May 26 12:49:42.079820 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 198/392] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:49:42 2022] GET /compute/v2.1/servers/9c87b8e9-adf1-40f0-b5d1-6efa2f25ab63 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:49:51.408568 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-41c065bc-b0c2-44fb-baf8-cf84eba3f087 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bf9d0267-8ae1-4469-b8b5-3c906ecd3af1"}} {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:49:51.409728 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-41c065bc-b0c2-44fb-baf8-cf84eba3f087 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: 7aa85144-0ebe-430c-b9e5-9b656ea4560a] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:51.412267 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG dbcounter [-] [124824] Writing DB stats nova_api:SELECT=9 {{(pid=124824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:51.413015 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG dbcounter [-] [124824] Writing DB stats nova_cell1:SELECT=48,nova_cell1:INSERT=1 {{(pid=124824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:51.418286 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-41c065bc-b0c2-44fb-baf8-cf84eba3f087 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:51.418737 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-41c065bc-b0c2-44fb-baf8-cf84eba3f087 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:51.419502 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-41c065bc-b0c2-44fb-baf8-cf84eba3f087 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:51.419939 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-41c065bc-b0c2-44fb-baf8-cf84eba3f087 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:53.718762 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-6f70770c-b1b7-4b08-8625-484d44a39eb2 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1266118466", "imageRef": "6df25342-b071-489b-a7c1-3089fa19af6d", "flavorRef": "452", "networks": [{"uuid": "bbe92bd3-5bf4-45da-a720-98219a4012c7"}]}} {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:49:53.726544 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG dbcounter [-] [124823] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=124823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:53.727741 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG dbcounter [-] [124823] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:53.775127 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.network.neutron [None req-6f70770c-b1b7-4b08-8625-484d44a39eb2 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] validate_networks() for [('bbe92bd3-5bf4-45da-a720-98219a4012c7', None, None, None, None, None)] {{(pid=124823) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 12:49:53.783937 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-41c065bc-b0c2-44fb-baf8-cf84eba3f087 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "POST /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.380634 May 26 12:49:53.789402 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 195/393] 10.222.0.41 () {60 vars in 1322 bytes} [Thu May 26 12:49:51 2022] POST /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a/os-volume_attachments => generated 194 bytes in 2383 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:49:54.328393 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.virt.hardware [None req-6f70770c-b1b7-4b08-8625-484d44a39eb2 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Flavor limits 0:0:0 {{(pid=124823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 12:49:54.328817 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.virt.hardware [None req-6f70770c-b1b7-4b08-8625-484d44a39eb2 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Image limits 0:0:0 {{(pid=124823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 12:49:54.329287 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.virt.hardware [None req-6f70770c-b1b7-4b08-8625-484d44a39eb2 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Flavor pref 0:0:0 {{(pid=124823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 12:49:54.329723 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.virt.hardware [None req-6f70770c-b1b7-4b08-8625-484d44a39eb2 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Image pref 0:0:0 {{(pid=124823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 12:49:54.330142 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.virt.hardware [None req-6f70770c-b1b7-4b08-8625-484d44a39eb2 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 12:49:54.339533 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-6f70770c-b1b7-4b08-8625-484d44a39eb2 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:54.339984 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-6f70770c-b1b7-4b08-8625-484d44a39eb2 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:54.340771 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-6f70770c-b1b7-4b08-8625-484d44a39eb2 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:54.341205 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-6f70770c-b1b7-4b08-8625-484d44a39eb2 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:54.358153 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.quota [None req-6f70770c-b1b7-4b08-8625-484d44a39eb2 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Getting quotas for project d539dfec943a44eb9b025d842a1f858d. Resources: {'instances', 'ram', 'cores'} {{(pid=124823) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:49:54.362029 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.quota [None req-6f70770c-b1b7-4b08-8625-484d44a39eb2 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Getting quotas for user 646a9abb1f9d4a1295a04defd895ff7c and project d539dfec943a44eb9b025d842a1f858d. Resources: {'instances', 'ram', 'cores'} {{(pid=124823) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:49:54.372651 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-6f70770c-b1b7-4b08-8625-484d44a39eb2 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Going to run 1 instances... {{(pid=124823) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 12:49:54.375019 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-6f70770c-b1b7-4b08-8625-484d44a39eb2 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] [instance: 4d941693-7aca-4eb9-b1eb-5add0d24b5c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6df25342-b071-489b-a7c1-3089fa19af6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124823) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 12:49:54.527937 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-6f70770c-b1b7-4b08-8625-484d44a39eb2 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.812996 May 26 12:49:54.528604 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 199/394] 10.222.0.41 () {60 vars in 1146 bytes} [Thu May 26 12:49:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 814 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 26 12:49:54.542816 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-a0a475dd-5ac5-455a-8edc-d591ab7f5d9d tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:54.543504 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-a0a475dd-5ac5-455a-8edc-d591ab7f5d9d tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] [instance: 4d941693-7aca-4eb9-b1eb-5add0d24b5c1] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:54.596371 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-a0a475dd-5ac5-455a-8edc-d591ab7f5d9d tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646a9abb1f9d4a1295a04defd895ff7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd539dfec943a44eb9b025d842a1f858d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:54.603983 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-a0a475dd-5ac5-455a-8edc-d591ab7f5d9d tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] 10.222.0.41 "GET /compute/v2.1/servers/4d941693-7aca-4eb9-b1eb-5add0d24b5c1" status: 200 len: 1219 microversion: 2.1 time: 0.066978 May 26 12:49:54.604559 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 196/395] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:49:54 2022] GET /compute/v2.1/servers/4d941693-7aca-4eb9-b1eb-5add0d24b5c1 => generated 1219 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:49:54.667695 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-3f5e4152-b237-4a72-a5b6-e0e08b85d7b3 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:54.668259 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-3f5e4152-b237-4a72-a5b6-e0e08b85d7b3 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: d6056156-21c7-47e2-9303-f90a8ec1b474] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:54.675193 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-3f5e4152-b237-4a72-a5b6-e0e08b85d7b3 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:54.675719 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-3f5e4152-b237-4a72-a5b6-e0e08b85d7b3 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:54.676558 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-3f5e4152-b237-4a72-a5b6-e0e08b85d7b3 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:54.677127 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-3f5e4152-b237-4a72-a5b6-e0e08b85d7b3 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:54.700953 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-3f5e4152-b237-4a72-a5b6-e0e08b85d7b3 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "GET /compute/v2.1/servers/d6056156-21c7-47e2-9303-f90a8ec1b474/ips" status: 200 len: 149 microversion: 2.1 time: 0.037184 May 26 12:49:54.701527 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 200/396] 10.222.0.41 () {58 vars in 1247 bytes} [Thu May 26 12:49:54 2022] GET /compute/v2.1/servers/d6056156-21c7-47e2-9303-f90a8ec1b474/ips => generated 149 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:49:54.712031 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-b5fe530b-a019-4b53-b35c-227d46e22d39 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "34f39cb2-c3fa-438e-9ba8-8aebf0964834"}} {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:49:54.713168 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-b5fe530b-a019-4b53-b35c-227d46e22d39 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: d6056156-21c7-47e2-9303-f90a8ec1b474] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:54.719435 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-b5fe530b-a019-4b53-b35c-227d46e22d39 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:54.719955 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-b5fe530b-a019-4b53-b35c-227d46e22d39 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:54.720721 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-b5fe530b-a019-4b53-b35c-227d46e22d39 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:54.721161 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-b5fe530b-a019-4b53-b35c-227d46e22d39 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:54.801206 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.wsgi [None req-b5fe530b-a019-4b53-b35c-227d46e22d39 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] HTTP exception thrown: Invalid volume: volume 34f39cb2-c3fa-438e-9ba8-8aebf0964834 is already attached to instances: 1a852e3a-0d2b-470a-a429-b4bac6aa8e6b May 26 12:49:54.803174 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-b5fe530b-a019-4b53-b35c-227d46e22d39 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Request method failure captured: May 26 12:49:54.803174 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: request: POST /compute/v2.1/servers/d6056156-21c7-47e2-9303-f90a8ec1b474/os-volume_attachments HTTP/1.1 May 26 12:49:54.803174 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Accept: application/json May 26 12:49:54.803174 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Accept-Encoding: identity May 26 12:49:54.803174 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Connection: close May 26 12:49:54.803174 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Content-Length: 74 May 26 12:49:54.803174 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Content-Type: application/json May 26 12:49:54.803174 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Host: 10.222.0.41 May 26 12:49:54.803174 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Openstack-System-Scope: None May 26 12:49:54.803174 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: User-Agent: python-urllib3/1.26.9 May 26 12:49:54.803174 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Auth-Token: gAAAAABij3aYTDT6d91IIen8MNgNrsA0ohBGn_dUC2tsponOFwNurwjlknBmFB36blSobobmDRibGa26en17LZfjuhgOSZiQsswJxea6OZWaEAKHfDkIbtu7XpKpGW-ZBZHCz2dZb9rYCBos_UyGkZJY7k8n757Ijkdz5EguRL9a0MDFor49yAU May 26 12:49:54.803174 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Domain-Id: None May 26 12:49:54.803174 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Domain-Name: None May 26 12:49:54.803174 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Identity-Status: Confirmed May 26 12:49:54.803174 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Is-Admin-Project: True May 26 12:49:54.803174 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Domain-Id: default May 26 12:49:54.803174 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Domain-Name: Default May 26 12:49:54.803174 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Id: cad768b45d17480d8d6bbbcff6032c8d May 26 12:49:54.803174 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Name: tempest-AttachVolumeNegativeTest-155076248 May 26 12:49:54.803174 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Role: member,reader May 26 12:49:54.803174 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Roles: member,reader May 26 12:49:54.804777 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/cad768b45d17480d8d6bbbcff6032c8d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/cad768b45d17480d8d6bbbcff6032c8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/cad768b45d17480d8d6bbbcff6032c8d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_cad768b45d17480d8d6bbbcff6032c8d", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 26 12:49:54.804777 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Tenant: tempest-AttachVolumeNegativeTest-155076248 May 26 12:49:54.804777 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Tenant-Id: cad768b45d17480d8d6bbbcff6032c8d May 26 12:49:54.804777 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-155076248 May 26 12:49:54.804777 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User: tempest-AttachVolumeNegativeTest-155076248-project May 26 12:49:54.804777 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Domain-Id: default May 26 12:49:54.804777 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Domain-Name: Default May 26 12:49:54.804777 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Id: 0537911b91184fcdbdcc9e93ec3fe5b9 May 26 12:49:54.804777 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Name: tempest-AttachVolumeNegativeTest-155076248-project May 26 12:49:54.804777 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: May 26 12:49:54.804777 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: {"volumeAttachment": {"volumeId": "34f39cb2-c3fa-438e-9ba8-8aebf0964834"}} May 26 12:49:54.804777 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: method: > May 26 12:49:54.806243 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: exception: Invalid volume: volume 34f39cb2-c3fa-438e-9ba8-8aebf0964834 is already attached to instances: 1a852e3a-0d2b-470a-a429-b4bac6aa8e6b May 26 12:49:54.806243 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: action_args: {'server_id': 'd6056156-21c7-47e2-9303-f90a8ec1b474', 'body': {'volumeAttachment': {'volumeId': '34f39cb2-c3fa-438e-9ba8-8aebf0964834'}}} May 26 12:49:54.806243 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:49:54.806243 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:49:54.806243 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 26 12:49:54.806243 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 26 12:49:54.806243 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 26 12:49:54.806243 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 12:49:54.806243 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 26 12:49:54.806243 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 26 12:49:54.806243 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 26 12:49:54.806243 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 26 12:49:54.806243 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 26 12:49:54.806243 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 26 12:49:54.806243 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 34f39cb2-c3fa-438e-9ba8-8aebf0964834 is already attached to instances: 1a852e3a-0d2b-470a-a429-b4bac6aa8e6b May 26 12:49:54.806243 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:49:54.806243 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:49:54.806243 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:49:54.806243 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:49:54.807660 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:49:54.807660 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:49:54.807660 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:49:54.807660 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:49:54.807660 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:49:54.807660 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:49:54.807660 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 12:49:54.807660 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 12:49:54.807660 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 12:49:54.807660 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 12:49:54.807660 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 12:49:54.807660 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 12:49:54.807660 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 26 12:49:54.807660 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 26 12:49:54.807660 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 34f39cb2-c3fa-438e-9ba8-8aebf0964834 is already attached to instances: 1a852e3a-0d2b-470a-a429-b4bac6aa8e6b May 26 12:49:54.807660 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:49:54.807660 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:49:54.807660 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:49:54.807660 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:49:54.807660 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:49:54.809085 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:49:54.809085 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:49:54.809085 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:49:54.809085 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 34f39cb2-c3fa-438e-9ba8-8aebf0964834 is already attached to instances: 1a852e3a-0d2b-470a-a429-b4bac6aa8e6b May 26 12:49:54.809085 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:49:54.809085 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-b5fe530b-a019-4b53-b35c-227d46e22d39 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Returning 400 to user: Invalid volume: volume 34f39cb2-c3fa-438e-9ba8-8aebf0964834 is already attached to instances: 1a852e3a-0d2b-470a-a429-b4bac6aa8e6b {{(pid=124824) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:49:54.809085 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-b5fe530b-a019-4b53-b35c-227d46e22d39 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "POST /compute/v2.1/servers/d6056156-21c7-47e2-9303-f90a8ec1b474/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.096722 May 26 12:49:54.809085 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 197/397] 10.222.0.41 () {60 vars in 1322 bytes} [Thu May 26 12:49:54 2022] POST /compute/v2.1/servers/d6056156-21c7-47e2-9303-f90a8ec1b474/os-volume_attachments => generated 174 bytes in 98 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 26 12:49:54.814196 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-93c0fdbe-d6b8-4d68-b7cd-0b153fe24a2a tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:54.814690 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-93c0fdbe-d6b8-4d68-b7cd-0b153fe24a2a tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: d6056156-21c7-47e2-9303-f90a8ec1b474] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:54.821987 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-93c0fdbe-d6b8-4d68-b7cd-0b153fe24a2a tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:54.822946 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-93c0fdbe-d6b8-4d68-b7cd-0b153fe24a2a tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:54.823297 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-93c0fdbe-d6b8-4d68-b7cd-0b153fe24a2a tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:54.823725 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-93c0fdbe-d6b8-4d68-b7cd-0b153fe24a2a tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:54.852589 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-93c0fdbe-d6b8-4d68-b7cd-0b153fe24a2a tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: d6056156-21c7-47e2-9303-f90a8ec1b474] Going to try to terminate instance {{(pid=124823) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 12:49:55.160877 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-93c0fdbe-d6b8-4d68-b7cd-0b153fe24a2a tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "DELETE /compute/v2.1/servers/d6056156-21c7-47e2-9303-f90a8ec1b474" status: 204 len: 0 microversion: 2.1 time: 0.350195 May 26 12:49:55.161496 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 201/398] 10.222.0.41 () {58 vars in 1238 bytes} [Thu May 26 12:49:54 2022] DELETE /compute/v2.1/servers/d6056156-21c7-47e2-9303-f90a8ec1b474 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 12:49:55.170302 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-4579756d-5f8e-48bf-aa72-fc6221441601 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:55.170914 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-4579756d-5f8e-48bf-aa72-fc6221441601 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: d6056156-21c7-47e2-9303-f90a8ec1b474] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:55.180021 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-4579756d-5f8e-48bf-aa72-fc6221441601 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:55.180971 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-4579756d-5f8e-48bf-aa72-fc6221441601 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:55.181768 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-4579756d-5f8e-48bf-aa72-fc6221441601 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:55.182206 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-4579756d-5f8e-48bf-aa72-fc6221441601 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:55.313545 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-4579756d-5f8e-48bf-aa72-fc6221441601 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0537911b91184fcdbdcc9e93ec3fe5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad768b45d17480d8d6bbbcff6032c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:55.321020 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-4579756d-5f8e-48bf-aa72-fc6221441601 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "GET /compute/v2.1/servers/d6056156-21c7-47e2-9303-f90a8ec1b474" status: 200 len: 1681 microversion: 2.1 time: 0.154587 May 26 12:49:55.321580 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 198/399] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:49:55 2022] GET /compute/v2.1/servers/d6056156-21c7-47e2-9303-f90a8ec1b474 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:49:55.621775 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-a19f5ce5-0d27-4a80-a966-e2c76523fde3 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:55.622547 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-a19f5ce5-0d27-4a80-a966-e2c76523fde3 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] [instance: 4d941693-7aca-4eb9-b1eb-5add0d24b5c1] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:55.628546 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-a19f5ce5-0d27-4a80-a966-e2c76523fde3 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:55.628989 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-a19f5ce5-0d27-4a80-a966-e2c76523fde3 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:55.629789 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-a19f5ce5-0d27-4a80-a966-e2c76523fde3 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:55.630221 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-a19f5ce5-0d27-4a80-a966-e2c76523fde3 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:55.692438 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-a19f5ce5-0d27-4a80-a966-e2c76523fde3 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646a9abb1f9d4a1295a04defd895ff7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd539dfec943a44eb9b025d842a1f858d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:55.700544 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-a19f5ce5-0d27-4a80-a966-e2c76523fde3 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] 10.222.0.41 "GET /compute/v2.1/servers/4d941693-7aca-4eb9-b1eb-5add0d24b5c1" status: 200 len: 1223 microversion: 2.1 time: 0.083370 May 26 12:49:55.701102 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 202/400] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:49:55 2022] GET /compute/v2.1/servers/4d941693-7aca-4eb9-b1eb-5add0d24b5c1 => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:49:56.339625 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-29257d93-dcc4-4a31-a7d8-3a39389ef281 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:56.340158 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-29257d93-dcc4-4a31-a7d8-3a39389ef281 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: d6056156-21c7-47e2-9303-f90a8ec1b474] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:56.347202 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-29257d93-dcc4-4a31-a7d8-3a39389ef281 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:56.347646 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-29257d93-dcc4-4a31-a7d8-3a39389ef281 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:56.348395 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-29257d93-dcc4-4a31-a7d8-3a39389ef281 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:56.349077 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-29257d93-dcc4-4a31-a7d8-3a39389ef281 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:56.497681 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-29257d93-dcc4-4a31-a7d8-3a39389ef281 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0537911b91184fcdbdcc9e93ec3fe5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad768b45d17480d8d6bbbcff6032c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:56.505959 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-29257d93-dcc4-4a31-a7d8-3a39389ef281 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "GET /compute/v2.1/servers/d6056156-21c7-47e2-9303-f90a8ec1b474" status: 200 len: 1681 microversion: 2.1 time: 0.171003 May 26 12:49:56.511706 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 199/401] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:49:56 2022] GET /compute/v2.1/servers/d6056156-21c7-47e2-9303-f90a8ec1b474 => generated 1681 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:49:56.717209 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-84cd6230-ea7e-4d47-aa32-157d13b88445 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:56.719916 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-84cd6230-ea7e-4d47-aa32-157d13b88445 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] [instance: 4d941693-7aca-4eb9-b1eb-5add0d24b5c1] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:56.724600 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-84cd6230-ea7e-4d47-aa32-157d13b88445 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:56.725051 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-84cd6230-ea7e-4d47-aa32-157d13b88445 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:56.725848 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-84cd6230-ea7e-4d47-aa32-157d13b88445 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:56.726293 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-84cd6230-ea7e-4d47-aa32-157d13b88445 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:56.790312 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-84cd6230-ea7e-4d47-aa32-157d13b88445 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646a9abb1f9d4a1295a04defd895ff7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd539dfec943a44eb9b025d842a1f858d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:56.797868 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-84cd6230-ea7e-4d47-aa32-157d13b88445 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] 10.222.0.41 "GET /compute/v2.1/servers/4d941693-7aca-4eb9-b1eb-5add0d24b5c1" status: 200 len: 1223 microversion: 2.1 time: 0.084438 May 26 12:49:56.798470 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 203/402] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:49:56 2022] GET /compute/v2.1/servers/4d941693-7aca-4eb9-b1eb-5add0d24b5c1 => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:49:57.526784 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-ac37d724-ce45-4237-8d14-c8a5e44036dd tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:57.527567 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-ac37d724-ce45-4237-8d14-c8a5e44036dd tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: d6056156-21c7-47e2-9303-f90a8ec1b474] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:57.534276 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-ac37d724-ce45-4237-8d14-c8a5e44036dd tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:57.534721 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-ac37d724-ce45-4237-8d14-c8a5e44036dd tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:57.535493 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-ac37d724-ce45-4237-8d14-c8a5e44036dd tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:57.535941 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-ac37d724-ce45-4237-8d14-c8a5e44036dd tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:57.815912 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-7f23a792-8ab1-46c8-81fe-ca6febc27f39 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:57.816604 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-7f23a792-8ab1-46c8-81fe-ca6febc27f39 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] [instance: 4d941693-7aca-4eb9-b1eb-5add0d24b5c1] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:57.824047 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-7f23a792-8ab1-46c8-81fe-ca6febc27f39 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:57.824502 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-7f23a792-8ab1-46c8-81fe-ca6febc27f39 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:57.825282 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-7f23a792-8ab1-46c8-81fe-ca6febc27f39 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:57.825766 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-7f23a792-8ab1-46c8-81fe-ca6febc27f39 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:57.841341 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-ac37d724-ce45-4237-8d14-c8a5e44036dd tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0537911b91184fcdbdcc9e93ec3fe5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad768b45d17480d8d6bbbcff6032c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:57.851392 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-ac37d724-ce45-4237-8d14-c8a5e44036dd tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "GET /compute/v2.1/servers/d6056156-21c7-47e2-9303-f90a8ec1b474" status: 200 len: 1681 microversion: 2.1 time: 0.328326 May 26 12:49:57.853400 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 200/403] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:49:57 2022] GET /compute/v2.1/servers/d6056156-21c7-47e2-9303-f90a8ec1b474 => generated 1681 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:49:57.893609 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-7f23a792-8ab1-46c8-81fe-ca6febc27f39 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646a9abb1f9d4a1295a04defd895ff7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd539dfec943a44eb9b025d842a1f858d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:57.903706 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-7f23a792-8ab1-46c8-81fe-ca6febc27f39 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] 10.222.0.41 "GET /compute/v2.1/servers/4d941693-7aca-4eb9-b1eb-5add0d24b5c1" status: 200 len: 1271 microversion: 2.1 time: 0.091918 May 26 12:49:57.904310 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 204/404] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:49:57 2022] GET /compute/v2.1/servers/4d941693-7aca-4eb9-b1eb-5add0d24b5c1 => generated 1271 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:49:58.638360 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [req-c6455e0a-60c1-4aab-b7dd-875378656f1e req-11fc9fe8-a77c-4937-b829-41b9056ed240 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6056156-21c7-47e2-9303-f90a8ec1b474", "name": "network-vif-deleted", "tag": "141703c8-60fb-4601-9241-65a9a0f37d8d"}]} {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:49:58.658375 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [req-c6455e0a-60c1-4aab-b7dd-875378656f1e req-11fc9fe8-a77c-4937-b829-41b9056ed240 service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:58.658819 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [req-c6455e0a-60c1-4aab-b7dd-875378656f1e req-11fc9fe8-a77c-4937-b829-41b9056ed240 service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:58.687994 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.compute.server_external_events [req-c6455e0a-60c1-4aab-b7dd-875378656f1e req-11fc9fe8-a77c-4937-b829-41b9056ed240 service nova] Creating event network-vif-deleted:141703c8-60fb-4601-9241-65a9a0f37d8d for instance d6056156-21c7-47e2-9303-f90a8ec1b474 on hv-cinder-81571 May 26 12:49:58.695405 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [req-c6455e0a-60c1-4aab-b7dd-875378656f1e req-11fc9fe8-a77c-4937-b829-41b9056ed240 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063908 May 26 12:49:58.700079 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 201/405] 10.222.0.41 () {64 vars in 1317 bytes} [Thu May 26 12:49:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:49:58.870736 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-6f5692b1-9ae2-4c40-8b4c-2a70021492f1 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:58.872034 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-6f5692b1-9ae2-4c40-8b4c-2a70021492f1 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: d6056156-21c7-47e2-9303-f90a8ec1b474] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:58.879440 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-6f5692b1-9ae2-4c40-8b4c-2a70021492f1 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:58.880565 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-6f5692b1-9ae2-4c40-8b4c-2a70021492f1 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:58.881609 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-6f5692b1-9ae2-4c40-8b4c-2a70021492f1 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:58.882317 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-6f5692b1-9ae2-4c40-8b4c-2a70021492f1 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:58.921014 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-21a5dd01-bbf4-4e74-8d1f-cb86baf6d34f tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:49:58.921781 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-21a5dd01-bbf4-4e74-8d1f-cb86baf6d34f tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] [instance: 4d941693-7aca-4eb9-b1eb-5add0d24b5c1] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:49:58.931794 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-21a5dd01-bbf4-4e74-8d1f-cb86baf6d34f tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:58.933630 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-21a5dd01-bbf4-4e74-8d1f-cb86baf6d34f tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:58.934608 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-21a5dd01-bbf4-4e74-8d1f-cb86baf6d34f tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:49:58.935456 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-21a5dd01-bbf4-4e74-8d1f-cb86baf6d34f tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:49:59.037800 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-21a5dd01-bbf4-4e74-8d1f-cb86baf6d34f tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646a9abb1f9d4a1295a04defd895ff7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd539dfec943a44eb9b025d842a1f858d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:59.049698 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-6f5692b1-9ae2-4c40-8b4c-2a70021492f1 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0537911b91184fcdbdcc9e93ec3fe5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad768b45d17480d8d6bbbcff6032c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:49:59.050401 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-21a5dd01-bbf4-4e74-8d1f-cb86baf6d34f tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] 10.222.0.41 "GET /compute/v2.1/servers/4d941693-7aca-4eb9-b1eb-5add0d24b5c1" status: 200 len: 1277 microversion: 2.1 time: 0.133576 May 26 12:49:59.051188 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 202/406] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:49:58 2022] GET /compute/v2.1/servers/4d941693-7aca-4eb9-b1eb-5add0d24b5c1 => generated 1277 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:49:59.058650 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-6f5692b1-9ae2-4c40-8b4c-2a70021492f1 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "GET /compute/v2.1/servers/d6056156-21c7-47e2-9303-f90a8ec1b474" status: 200 len: 1326 microversion: 2.1 time: 0.192136 May 26 12:49:59.076147 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 205/407] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:49:58 2022] GET /compute/v2.1/servers/d6056156-21c7-47e2-9303-f90a8ec1b474 => generated 1326 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:00.083629 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-176a2a1c-a5fe-4380-a58a-67c1f468b7f3 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:00.084290 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-176a2a1c-a5fe-4380-a58a-67c1f468b7f3 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] [instance: 4d941693-7aca-4eb9-b1eb-5add0d24b5c1] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:00.090497 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-ea23b70c-ef92-42ee-9fb2-e4b3a736db14 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:00.091121 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-ea23b70c-ef92-42ee-9fb2-e4b3a736db14 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: d6056156-21c7-47e2-9303-f90a8ec1b474] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:00.091891 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-176a2a1c-a5fe-4380-a58a-67c1f468b7f3 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:00.092533 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-176a2a1c-a5fe-4380-a58a-67c1f468b7f3 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:00.093894 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-176a2a1c-a5fe-4380-a58a-67c1f468b7f3 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:00.094989 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-176a2a1c-a5fe-4380-a58a-67c1f468b7f3 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:00.101308 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-ea23b70c-ef92-42ee-9fb2-e4b3a736db14 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:00.104794 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-ea23b70c-ef92-42ee-9fb2-e4b3a736db14 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:00.106920 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-ea23b70c-ef92-42ee-9fb2-e4b3a736db14 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:00.106920 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-ea23b70c-ef92-42ee-9fb2-e4b3a736db14 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:00.141950 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.wsgi [None req-ea23b70c-ef92-42ee-9fb2-e4b3a736db14 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] HTTP exception thrown: Instance d6056156-21c7-47e2-9303-f90a8ec1b474 could not be found. May 26 12:50:00.145279 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-ea23b70c-ef92-42ee-9fb2-e4b3a736db14 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Request method failure captured: May 26 12:50:00.145279 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: request: GET /compute/v2.1/servers/d6056156-21c7-47e2-9303-f90a8ec1b474 HTTP/1.1 May 26 12:50:00.145279 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Accept: application/json May 26 12:50:00.145279 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Accept-Encoding: identity May 26 12:50:00.145279 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Connection: close May 26 12:50:00.145279 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Content-Length: 0 May 26 12:50:00.145279 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Content-Type: application/json May 26 12:50:00.145279 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Host: 10.222.0.41 May 26 12:50:00.145279 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Openstack-System-Scope: None May 26 12:50:00.145279 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: User-Agent: python-urllib3/1.26.9 May 26 12:50:00.145279 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Auth-Token: gAAAAABij3aYTDT6d91IIen8MNgNrsA0ohBGn_dUC2tsponOFwNurwjlknBmFB36blSobobmDRibGa26en17LZfjuhgOSZiQsswJxea6OZWaEAKHfDkIbtu7XpKpGW-ZBZHCz2dZb9rYCBos_UyGkZJY7k8n757Ijkdz5EguRL9a0MDFor49yAU May 26 12:50:00.145279 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Domain-Id: None May 26 12:50:00.145279 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Domain-Name: None May 26 12:50:00.145279 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Identity-Status: Confirmed May 26 12:50:00.145279 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Is-Admin-Project: True May 26 12:50:00.145279 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Domain-Id: default May 26 12:50:00.145279 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Domain-Name: Default May 26 12:50:00.145279 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Id: cad768b45d17480d8d6bbbcff6032c8d May 26 12:50:00.145279 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Name: tempest-AttachVolumeNegativeTest-155076248 May 26 12:50:00.145279 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Role: member,reader May 26 12:50:00.145279 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Roles: member,reader May 26 12:50:00.146540 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/cad768b45d17480d8d6bbbcff6032c8d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/cad768b45d17480d8d6bbbcff6032c8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/cad768b45d17480d8d6bbbcff6032c8d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_cad768b45d17480d8d6bbbcff6032c8d", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 26 12:50:00.146540 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Tenant: tempest-AttachVolumeNegativeTest-155076248 May 26 12:50:00.146540 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Tenant-Id: cad768b45d17480d8d6bbbcff6032c8d May 26 12:50:00.146540 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-155076248 May 26 12:50:00.146540 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User: tempest-AttachVolumeNegativeTest-155076248-project May 26 12:50:00.146540 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Domain-Id: default May 26 12:50:00.146540 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Domain-Name: Default May 26 12:50:00.146540 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Id: 0537911b91184fcdbdcc9e93ec3fe5b9 May 26 12:50:00.146540 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Name: tempest-AttachVolumeNegativeTest-155076248-project May 26 12:50:00.146540 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: method: > May 26 12:50:00.146540 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: exception: Instance d6056156-21c7-47e2-9303-f90a8ec1b474 could not be found. May 26 12:50:00.146540 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: action_args: {'id': 'd6056156-21c7-47e2-9303-f90a8ec1b474'} May 26 12:50:00.147218 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:50:00.147218 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:50:00.147218 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:50:00.147218 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:50:00.147218 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:50:00.147218 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:50:00.147218 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:50:00.147218 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:50:00.147218 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:50:00.147218 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:50:00.147218 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6056156-21c7-47e2-9303-f90a8ec1b474 could not be found. May 26 12:50:00.147218 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:50:00.147218 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:50:00.147218 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:50:00.147218 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:50:00.147218 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:50:00.147218 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:50:00.147218 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:50:00.147218 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:50:00.147218 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:50:00.148410 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:50:00.148410 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 12:50:00.148410 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 12:50:00.148410 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:50:00.148410 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:50:00.148410 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:50:00.148410 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:50:00.148410 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6056156-21c7-47e2-9303-f90a8ec1b474 could not be found. May 26 12:50:00.148410 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:50:00.148410 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:50:00.148410 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:50:00.148410 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:50:00.148410 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:50:00.148410 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:50:00.148410 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:50:00.148410 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:50:00.148410 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6056156-21c7-47e2-9303-f90a8ec1b474 could not be found. May 26 12:50:00.148410 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:50:00.149457 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-ea23b70c-ef92-42ee-9fb2-e4b3a736db14 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Returning 404 to user: Instance d6056156-21c7-47e2-9303-f90a8ec1b474 could not be found. {{(pid=124824) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:50:00.149457 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-ea23b70c-ef92-42ee-9fb2-e4b3a736db14 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "GET /compute/v2.1/servers/d6056156-21c7-47e2-9303-f90a8ec1b474" status: 404 len: 111 microversion: 2.1 time: 0.068167 May 26 12:50:00.153243 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 203/408] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:50:00 2022] GET /compute/v2.1/servers/d6056156-21c7-47e2-9303-f90a8ec1b474 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:50:00.157922 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-27b9989e-44f0-409a-a3c8-2ed7fbb942de tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '.version_select at 0x7f26a1e5a790>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:00.271847 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-27b9989e-44f0-409a-a3c8-2ed7fbb942de tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-399683608" status: 202 len: 0 microversion: 2.1 time: 0.117453 May 26 12:50:00.275297 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 204/409] 10.222.0.41 () {58 vars in 1217 bytes} [Thu May 26 12:50:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-399683608 => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 12:50:00.344124 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-176a2a1c-a5fe-4380-a58a-67c1f468b7f3 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646a9abb1f9d4a1295a04defd895ff7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd539dfec943a44eb9b025d842a1f858d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:00.352420 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-176a2a1c-a5fe-4380-a58a-67c1f468b7f3 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] 10.222.0.41 "GET /compute/v2.1/servers/4d941693-7aca-4eb9-b1eb-5add0d24b5c1" status: 200 len: 1319 microversion: 2.1 time: 0.272102 May 26 12:50:00.358892 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 206/410] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:50:00 2022] GET /compute/v2.1/servers/4d941693-7aca-4eb9-b1eb-5add0d24b5c1 => generated 1319 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:00.413329 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [req-3a68ec40-bcf2-4483-8a99-fba9e93ec12f req-a2114d74-3a62-40d7-843a-0ab8ee950385 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d941693-7aca-4eb9-b1eb-5add0d24b5c1", "tag": "efe77520-8c46-4866-b802-5b04f9dea304"}]} {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:50:00.427928 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [req-3a68ec40-bcf2-4483-8a99-fba9e93ec12f req-a2114d74-3a62-40d7-843a-0ab8ee950385 service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:00.430498 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [req-3a68ec40-bcf2-4483-8a99-fba9e93ec12f req-a2114d74-3a62-40d7-843a-0ab8ee950385 service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:00.442906 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.compute.server_external_events [req-3a68ec40-bcf2-4483-8a99-fba9e93ec12f req-a2114d74-3a62-40d7-843a-0ab8ee950385 service nova] Creating event network-changed:efe77520-8c46-4866-b802-5b04f9dea304 for instance 4d941693-7aca-4eb9-b1eb-5add0d24b5c1 on hv-cinder-81571 May 26 12:50:00.448899 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [req-3a68ec40-bcf2-4483-8a99-fba9e93ec12f req-a2114d74-3a62-40d7-843a-0ab8ee950385 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039394 May 26 12:50:00.449631 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 205/411] 10.222.0.41 () {64 vars in 1317 bytes} [Thu May 26 12:50:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:50:01.191426 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-95f3a4da-721a-4a6e-b787-8b7f3af8f386 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:01.191982 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-95f3a4da-721a-4a6e-b787-8b7f3af8f386 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: 1a852e3a-0d2b-470a-a429-b4bac6aa8e6b] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:01.198427 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-95f3a4da-721a-4a6e-b787-8b7f3af8f386 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:01.199189 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-95f3a4da-721a-4a6e-b787-8b7f3af8f386 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:01.200223 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-95f3a4da-721a-4a6e-b787-8b7f3af8f386 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:01.200759 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-95f3a4da-721a-4a6e-b787-8b7f3af8f386 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:01.334155 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.objects.instance [None req-95f3a4da-721a-4a6e-b787-8b7f3af8f386 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lazy-loading 'services' on Instance uuid 1a852e3a-0d2b-470a-a429-b4bac6aa8e6b {{(pid=124823) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:50:01.370619 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-0910bc55-07dc-4fc4-9b1d-4ea3e535fbf0 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:01.371902 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-0910bc55-07dc-4fc4-9b1d-4ea3e535fbf0 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] [instance: 4d941693-7aca-4eb9-b1eb-5add0d24b5c1] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:01.380012 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-0910bc55-07dc-4fc4-9b1d-4ea3e535fbf0 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:01.380465 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-0910bc55-07dc-4fc4-9b1d-4ea3e535fbf0 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:01.381396 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-0910bc55-07dc-4fc4-9b1d-4ea3e535fbf0 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:01.381881 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-0910bc55-07dc-4fc4-9b1d-4ea3e535fbf0 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:01.526752 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-0910bc55-07dc-4fc4-9b1d-4ea3e535fbf0 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646a9abb1f9d4a1295a04defd895ff7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd539dfec943a44eb9b025d842a1f858d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:01.534270 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-0910bc55-07dc-4fc4-9b1d-4ea3e535fbf0 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] 10.222.0.41 "GET /compute/v2.1/servers/4d941693-7aca-4eb9-b1eb-5add0d24b5c1" status: 200 len: 1319 microversion: 2.1 time: 0.167996 May 26 12:50:01.534832 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 206/412] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:50:01 2022] GET /compute/v2.1/servers/4d941693-7aca-4eb9-b1eb-5add0d24b5c1 => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:01.618935 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-95f3a4da-721a-4a6e-b787-8b7f3af8f386 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "DELETE /compute/v2.1/servers/1a852e3a-0d2b-470a-a429-b4bac6aa8e6b/os-volume_attachments/34f39cb2-c3fa-438e-9ba8-8aebf0964834" status: 202 len: 0 microversion: 2.1 time: 0.431290 May 26 12:50:01.619637 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 207/413] 10.222.0.41 () {58 vars in 1415 bytes} [Thu May 26 12:50:01 2022] DELETE /compute/v2.1/servers/1a852e3a-0d2b-470a-a429-b4bac6aa8e6b/os-volume_attachments/34f39cb2-c3fa-438e-9ba8-8aebf0964834 => generated 0 bytes in 433 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 12:50:01.627945 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-db33d8eb-63a5-4d31-9d23-80f4dbcee59c tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:01.628907 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-db33d8eb-63a5-4d31-9d23-80f4dbcee59c tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: 1a852e3a-0d2b-470a-a429-b4bac6aa8e6b] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:01.635483 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-db33d8eb-63a5-4d31-9d23-80f4dbcee59c tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:01.635923 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-db33d8eb-63a5-4d31-9d23-80f4dbcee59c tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:01.636685 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-db33d8eb-63a5-4d31-9d23-80f4dbcee59c tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:01.637115 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-db33d8eb-63a5-4d31-9d23-80f4dbcee59c tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:01.667153 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-db33d8eb-63a5-4d31-9d23-80f4dbcee59c tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "GET /compute/v2.1/servers/1a852e3a-0d2b-470a-a429-b4bac6aa8e6b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043112 May 26 12:50:01.667756 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 207/414] 10.222.0.41 () {58 vars in 1301 bytes} [Thu May 26 12:50:01 2022] GET /compute/v2.1/servers/1a852e3a-0d2b-470a-a429-b4bac6aa8e6b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:50:02.552648 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-f697ca1b-f34a-4921-b33b-dc9d9f014606 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:02.553346 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-f697ca1b-f34a-4921-b33b-dc9d9f014606 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] [instance: 4d941693-7aca-4eb9-b1eb-5add0d24b5c1] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:02.560626 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-f697ca1b-f34a-4921-b33b-dc9d9f014606 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:02.561073 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-f697ca1b-f34a-4921-b33b-dc9d9f014606 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:02.561872 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-f697ca1b-f34a-4921-b33b-dc9d9f014606 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:02.562312 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-f697ca1b-f34a-4921-b33b-dc9d9f014606 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:02.678168 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-16c2a235-e973-42d7-8d12-58569ba28a65 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:02.679087 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-16c2a235-e973-42d7-8d12-58569ba28a65 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: 1a852e3a-0d2b-470a-a429-b4bac6aa8e6b] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:02.688394 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-16c2a235-e973-42d7-8d12-58569ba28a65 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:02.688394 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-16c2a235-e973-42d7-8d12-58569ba28a65 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:02.693176 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-16c2a235-e973-42d7-8d12-58569ba28a65 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:02.693176 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-16c2a235-e973-42d7-8d12-58569ba28a65 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:02.713336 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-f697ca1b-f34a-4921-b33b-dc9d9f014606 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646a9abb1f9d4a1295a04defd895ff7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd539dfec943a44eb9b025d842a1f858d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:02.722965 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-16c2a235-e973-42d7-8d12-58569ba28a65 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "GET /compute/v2.1/servers/1a852e3a-0d2b-470a-a429-b4bac6aa8e6b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048699 May 26 12:50:02.724107 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 208/415] 10.222.0.41 () {58 vars in 1301 bytes} [Thu May 26 12:50:02 2022] GET /compute/v2.1/servers/1a852e3a-0d2b-470a-a429-b4bac6aa8e6b/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:50:02.729324 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-f697ca1b-f34a-4921-b33b-dc9d9f014606 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] 10.222.0.41 "GET /compute/v2.1/servers/4d941693-7aca-4eb9-b1eb-5add0d24b5c1" status: 200 len: 1319 microversion: 2.1 time: 0.180866 May 26 12:50:02.731731 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 208/416] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:50:02 2022] GET /compute/v2.1/servers/4d941693-7aca-4eb9-b1eb-5add0d24b5c1 => generated 1319 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:03.738041 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-21da347d-ab78-419c-8184-adfecbd73cba tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:03.739255 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-21da347d-ab78-419c-8184-adfecbd73cba tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: 1a852e3a-0d2b-470a-a429-b4bac6aa8e6b] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:03.748522 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-820004ae-0188-4a5c-857f-1e343f52c3c1 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:03.749248 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-820004ae-0188-4a5c-857f-1e343f52c3c1 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] [instance: 4d941693-7aca-4eb9-b1eb-5add0d24b5c1] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:03.749690 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-21da347d-ab78-419c-8184-adfecbd73cba tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:03.750314 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-21da347d-ab78-419c-8184-adfecbd73cba tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:03.752409 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-21da347d-ab78-419c-8184-adfecbd73cba tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:03.753170 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-21da347d-ab78-419c-8184-adfecbd73cba tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:03.758163 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-820004ae-0188-4a5c-857f-1e343f52c3c1 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:03.758837 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-820004ae-0188-4a5c-857f-1e343f52c3c1 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:03.766797 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-820004ae-0188-4a5c-857f-1e343f52c3c1 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:03.767401 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-820004ae-0188-4a5c-857f-1e343f52c3c1 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:03.808119 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-21da347d-ab78-419c-8184-adfecbd73cba tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "GET /compute/v2.1/servers/1a852e3a-0d2b-470a-a429-b4bac6aa8e6b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074912 May 26 12:50:03.812087 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 209/417] 10.222.0.41 () {58 vars in 1301 bytes} [Thu May 26 12:50:03 2022] GET /compute/v2.1/servers/1a852e3a-0d2b-470a-a429-b4bac6aa8e6b/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:50:03.987172 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-820004ae-0188-4a5c-857f-1e343f52c3c1 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646a9abb1f9d4a1295a04defd895ff7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd539dfec943a44eb9b025d842a1f858d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:03.995001 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-820004ae-0188-4a5c-857f-1e343f52c3c1 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] 10.222.0.41 "GET /compute/v2.1/servers/4d941693-7aca-4eb9-b1eb-5add0d24b5c1" status: 200 len: 1319 microversion: 2.1 time: 0.252045 May 26 12:50:03.995578 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 209/418] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:50:03 2022] GET /compute/v2.1/servers/4d941693-7aca-4eb9-b1eb-5add0d24b5c1 => generated 1319 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:04.538401 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-caf69ae5-617f-40c4-896c-4604c11a0602 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:50:04.539689 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-caf69ae5-617f-40c4-896c-4604c11a0602 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: 7aa85144-0ebe-430c-b9e5-9b656ea4560a] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:04.545623 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-caf69ae5-617f-40c4-896c-4604c11a0602 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:04.546312 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-caf69ae5-617f-40c4-896c-4604c11a0602 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:04.547088 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-caf69ae5-617f-40c4-896c-4604c11a0602 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:04.547521 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-caf69ae5-617f-40c4-896c-4604c11a0602 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:04.573088 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.objects.instance [None req-caf69ae5-617f-40c4-896c-4604c11a0602 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lazy-loading 'flavor' on Instance uuid 7aa85144-0ebe-430c-b9e5-9b656ea4560a {{(pid=124824) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:50:04.602598 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG dbcounter [-] [124824] Writing DB stats nova_cell0:SELECT=2 {{(pid=124824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:50:04.824123 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-b372e29b-997c-4797-a8fc-4ababf00c26a tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:04.824123 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-b372e29b-997c-4797-a8fc-4ababf00c26a tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: 1a852e3a-0d2b-470a-a429-b4bac6aa8e6b] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:04.831454 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG dbcounter [-] [124823] Writing DB stats nova_cell0:SELECT=2 {{(pid=124823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:50:04.831992 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG dbcounter [-] [124823] Writing DB stats nova_cell0:SELECT=6 {{(pid=124823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:50:04.834622 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-b372e29b-997c-4797-a8fc-4ababf00c26a tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:04.835072 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-b372e29b-997c-4797-a8fc-4ababf00c26a tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:04.835855 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-b372e29b-997c-4797-a8fc-4ababf00c26a tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:04.836327 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-b372e29b-997c-4797-a8fc-4ababf00c26a tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:04.870817 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-b372e29b-997c-4797-a8fc-4ababf00c26a tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "GET /compute/v2.1/servers/1a852e3a-0d2b-470a-a429-b4bac6aa8e6b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054387 May 26 12:50:04.871371 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 210/419] 10.222.0.41 () {58 vars in 1301 bytes} [Thu May 26 12:50:04 2022] GET /compute/v2.1/servers/1a852e3a-0d2b-470a-a429-b4bac6aa8e6b/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:50:05.011480 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-04fdd7a4-c308-4258-b8da-247de99dc42c tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:05.012073 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-04fdd7a4-c308-4258-b8da-247de99dc42c tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] [instance: 4d941693-7aca-4eb9-b1eb-5add0d24b5c1] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:05.017568 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-caf69ae5-617f-40c4-896c-4604c11a0602 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "POST /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a/action" status: 200 len: 32 microversion: 2.1 time: 0.483123 May 26 12:50:05.018273 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 210/420] 10.222.0.41 () {60 vars in 1277 bytes} [Thu May 26 12:50:04 2022] POST /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a/action => generated 32 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 12:50:05.018528 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-04fdd7a4-c308-4258-b8da-247de99dc42c tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:05.019047 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-04fdd7a4-c308-4258-b8da-247de99dc42c tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:05.019915 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-04fdd7a4-c308-4258-b8da-247de99dc42c tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:05.020290 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-04fdd7a4-c308-4258-b8da-247de99dc42c tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:05.028841 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-6bd04ac7-57e2-42c9-9522-5c901449d092 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:05.029534 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-6bd04ac7-57e2-42c9-9522-5c901449d092 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: 7aa85144-0ebe-430c-b9e5-9b656ea4560a] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:05.036081 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-6bd04ac7-57e2-42c9-9522-5c901449d092 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:05.037120 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-6bd04ac7-57e2-42c9-9522-5c901449d092 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:05.037325 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-6bd04ac7-57e2-42c9-9522-5c901449d092 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:05.037864 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-6bd04ac7-57e2-42c9-9522-5c901449d092 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:05.173977 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-6bd04ac7-57e2-42c9-9522-5c901449d092 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:05.178363 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-04fdd7a4-c308-4258-b8da-247de99dc42c tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646a9abb1f9d4a1295a04defd895ff7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd539dfec943a44eb9b025d842a1f858d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:05.182110 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-6bd04ac7-57e2-42c9-9522-5c901449d092 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a" status: 200 len: 1734 microversion: 2.1 time: 0.157479 May 26 12:50:05.182351 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-04fdd7a4-c308-4258-b8da-247de99dc42c tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] 10.222.0.41 "GET /compute/v2.1/servers/4d941693-7aca-4eb9-b1eb-5add0d24b5c1" status: 200 len: 1319 microversion: 2.1 time: 0.174572 May 26 12:50:05.182682 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 211/421] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:50:05 2022] GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:05.185722 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 211/422] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:50:05 2022] GET /compute/v2.1/servers/4d941693-7aca-4eb9-b1eb-5add0d24b5c1 => generated 1319 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:50:05.882247 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-99f7a0c2-4519-4a9b-ba21-0c3f8a9648e3 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:05.883944 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-99f7a0c2-4519-4a9b-ba21-0c3f8a9648e3 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: 1a852e3a-0d2b-470a-a429-b4bac6aa8e6b] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:05.892669 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-99f7a0c2-4519-4a9b-ba21-0c3f8a9648e3 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:05.892784 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-99f7a0c2-4519-4a9b-ba21-0c3f8a9648e3 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:05.893799 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-99f7a0c2-4519-4a9b-ba21-0c3f8a9648e3 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:05.894242 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-99f7a0c2-4519-4a9b-ba21-0c3f8a9648e3 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:05.898144 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG dbcounter [-] [124824] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:50:05.926753 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-99f7a0c2-4519-4a9b-ba21-0c3f8a9648e3 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "GET /compute/v2.1/servers/1a852e3a-0d2b-470a-a429-b4bac6aa8e6b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047967 May 26 12:50:05.927520 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 212/423] 10.222.0.41 () {58 vars in 1301 bytes} [Thu May 26 12:50:05 2022] GET /compute/v2.1/servers/1a852e3a-0d2b-470a-a429-b4bac6aa8e6b/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:50:06.199400 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-0fa3a191-26d6-4168-bed0-64e41a2d5c46 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:06.200596 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-0fa3a191-26d6-4168-bed0-64e41a2d5c46 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: 7aa85144-0ebe-430c-b9e5-9b656ea4560a] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:06.200772 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-47de4473-855c-4a26-9a80-5043f7c82f00 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:06.201554 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-47de4473-855c-4a26-9a80-5043f7c82f00 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] [instance: 4d941693-7aca-4eb9-b1eb-5add0d24b5c1] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:06.211058 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-0fa3a191-26d6-4168-bed0-64e41a2d5c46 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:06.211058 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-0fa3a191-26d6-4168-bed0-64e41a2d5c46 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:06.211058 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-0fa3a191-26d6-4168-bed0-64e41a2d5c46 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:06.211753 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-0fa3a191-26d6-4168-bed0-64e41a2d5c46 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:06.212455 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-47de4473-855c-4a26-9a80-5043f7c82f00 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:06.213128 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-47de4473-855c-4a26-9a80-5043f7c82f00 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:06.214521 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-47de4473-855c-4a26-9a80-5043f7c82f00 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:06.215068 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-47de4473-855c-4a26-9a80-5043f7c82f00 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:06.359975 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-0fa3a191-26d6-4168-bed0-64e41a2d5c46 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:06.368780 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-0fa3a191-26d6-4168-bed0-64e41a2d5c46 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a" status: 200 len: 1734 microversion: 2.1 time: 0.173136 May 26 12:50:06.369368 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 212/424] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:50:06 2022] GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a => generated 1734 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:06.424646 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-47de4473-855c-4a26-9a80-5043f7c82f00 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646a9abb1f9d4a1295a04defd895ff7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd539dfec943a44eb9b025d842a1f858d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:06.431836 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-47de4473-855c-4a26-9a80-5043f7c82f00 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] 10.222.0.41 "GET /compute/v2.1/servers/4d941693-7aca-4eb9-b1eb-5add0d24b5c1" status: 200 len: 1319 microversion: 2.1 time: 0.236123 May 26 12:50:06.432421 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 213/425] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:50:06 2022] GET /compute/v2.1/servers/4d941693-7aca-4eb9-b1eb-5add0d24b5c1 => generated 1319 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:50:06.939537 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-f97dc08b-a6aa-4a5f-9612-fd9aa1b6d432 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:06.940499 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-f97dc08b-a6aa-4a5f-9612-fd9aa1b6d432 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: 1a852e3a-0d2b-470a-a429-b4bac6aa8e6b] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:06.946702 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-f97dc08b-a6aa-4a5f-9612-fd9aa1b6d432 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:06.947145 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-f97dc08b-a6aa-4a5f-9612-fd9aa1b6d432 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:06.948347 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-f97dc08b-a6aa-4a5f-9612-fd9aa1b6d432 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:06.948955 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-f97dc08b-a6aa-4a5f-9612-fd9aa1b6d432 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:06.978518 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-f97dc08b-a6aa-4a5f-9612-fd9aa1b6d432 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "GET /compute/v2.1/servers/1a852e3a-0d2b-470a-a429-b4bac6aa8e6b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043208 May 26 12:50:06.978995 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 213/426] 10.222.0.41 () {58 vars in 1301 bytes} [Thu May 26 12:50:06 2022] GET /compute/v2.1/servers/1a852e3a-0d2b-470a-a429-b4bac6aa8e6b/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 26 12:50:07.037821 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-9429a3cf-2b48-44bf-bd99-df11e1dc90cf tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:07.038319 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-9429a3cf-2b48-44bf-bd99-df11e1dc90cf tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: 1a852e3a-0d2b-470a-a429-b4bac6aa8e6b] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:07.045791 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-9429a3cf-2b48-44bf-bd99-df11e1dc90cf tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:07.046236 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-9429a3cf-2b48-44bf-bd99-df11e1dc90cf tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:07.047005 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-9429a3cf-2b48-44bf-bd99-df11e1dc90cf tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:07.047436 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-9429a3cf-2b48-44bf-bd99-df11e1dc90cf tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:07.074716 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-9429a3cf-2b48-44bf-bd99-df11e1dc90cf tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: 1a852e3a-0d2b-470a-a429-b4bac6aa8e6b] Going to try to terminate instance {{(pid=124824) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 12:50:07.387377 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-576fbd3d-108e-499e-83a9-da191b20bdf1 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:07.388001 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-576fbd3d-108e-499e-83a9-da191b20bdf1 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: 7aa85144-0ebe-430c-b9e5-9b656ea4560a] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:07.394792 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-576fbd3d-108e-499e-83a9-da191b20bdf1 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:07.399078 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-576fbd3d-108e-499e-83a9-da191b20bdf1 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:07.399078 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-576fbd3d-108e-499e-83a9-da191b20bdf1 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:07.399078 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-576fbd3d-108e-499e-83a9-da191b20bdf1 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:07.400925 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG dbcounter [-] [124823] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=124823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:50:07.419767 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-9429a3cf-2b48-44bf-bd99-df11e1dc90cf tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "DELETE /compute/v2.1/servers/1a852e3a-0d2b-470a-a429-b4bac6aa8e6b" status: 204 len: 0 microversion: 2.1 time: 0.385616 May 26 12:50:07.420461 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 214/427] 10.222.0.41 () {58 vars in 1238 bytes} [Thu May 26 12:50:07 2022] DELETE /compute/v2.1/servers/1a852e3a-0d2b-470a-a429-b4bac6aa8e6b => generated 0 bytes in 387 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 12:50:07.429111 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-fc004140-88ce-47be-ac25-06d997c07146 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:07.429825 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-fc004140-88ce-47be-ac25-06d997c07146 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: 1a852e3a-0d2b-470a-a429-b4bac6aa8e6b] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:07.436032 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-fc004140-88ce-47be-ac25-06d997c07146 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:07.436468 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-fc004140-88ce-47be-ac25-06d997c07146 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:07.437414 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-fc004140-88ce-47be-ac25-06d997c07146 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:07.437886 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-fc004140-88ce-47be-ac25-06d997c07146 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:07.553585 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-576fbd3d-108e-499e-83a9-da191b20bdf1 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:07.561555 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-576fbd3d-108e-499e-83a9-da191b20bdf1 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a" status: 200 len: 1734 microversion: 2.1 time: 0.178963 May 26 12:50:07.562172 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 214/428] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:50:07 2022] GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a => generated 1734 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:50:07.567169 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-a6d24637-4744-4dde-b682-e4e4ba808b5c tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:07.567977 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-a6d24637-4744-4dde-b682-e4e4ba808b5c tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] [instance: 4d941693-7aca-4eb9-b1eb-5add0d24b5c1] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:07.575607 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-a6d24637-4744-4dde-b682-e4e4ba808b5c tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:07.576059 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-a6d24637-4744-4dde-b682-e4e4ba808b5c tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:07.576847 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-a6d24637-4744-4dde-b682-e4e4ba808b5c tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:07.577288 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-a6d24637-4744-4dde-b682-e4e4ba808b5c tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:07.583706 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-fc004140-88ce-47be-ac25-06d997c07146 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0537911b91184fcdbdcc9e93ec3fe5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad768b45d17480d8d6bbbcff6032c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:07.592327 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-fc004140-88ce-47be-ac25-06d997c07146 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "GET /compute/v2.1/servers/1a852e3a-0d2b-470a-a429-b4bac6aa8e6b" status: 200 len: 1679 microversion: 2.1 time: 0.167271 May 26 12:50:07.592991 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 215/429] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:50:07 2022] GET /compute/v2.1/servers/1a852e3a-0d2b-470a-a429-b4bac6aa8e6b => generated 1679 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:50:07.710728 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-a6d24637-4744-4dde-b682-e4e4ba808b5c tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646a9abb1f9d4a1295a04defd895ff7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd539dfec943a44eb9b025d842a1f858d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:07.718767 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-a6d24637-4744-4dde-b682-e4e4ba808b5c tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] 10.222.0.41 "GET /compute/v2.1/servers/4d941693-7aca-4eb9-b1eb-5add0d24b5c1" status: 200 len: 1319 microversion: 2.1 time: 0.155393 May 26 12:50:07.719343 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 215/430] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:50:07 2022] GET /compute/v2.1/servers/4d941693-7aca-4eb9-b1eb-5add0d24b5c1 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:08.580303 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-6c5c4a64-627c-4480-ab2d-67fc27c64ce3 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:08.580900 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-6c5c4a64-627c-4480-ab2d-67fc27c64ce3 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: 7aa85144-0ebe-430c-b9e5-9b656ea4560a] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:08.587659 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-6c5c4a64-627c-4480-ab2d-67fc27c64ce3 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:08.588107 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-6c5c4a64-627c-4480-ab2d-67fc27c64ce3 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:08.590926 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-6c5c4a64-627c-4480-ab2d-67fc27c64ce3 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:08.590926 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-6c5c4a64-627c-4480-ab2d-67fc27c64ce3 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:08.609292 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-9b2f3e6e-5a25-4e3f-a852-1807312642b1 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:08.610095 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-9b2f3e6e-5a25-4e3f-a852-1807312642b1 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: 1a852e3a-0d2b-470a-a429-b4bac6aa8e6b] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:08.617284 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-9b2f3e6e-5a25-4e3f-a852-1807312642b1 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:08.619656 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-9b2f3e6e-5a25-4e3f-a852-1807312642b1 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:08.619656 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-9b2f3e6e-5a25-4e3f-a852-1807312642b1 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:08.619656 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-9b2f3e6e-5a25-4e3f-a852-1807312642b1 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:08.734316 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-6c5c4a64-627c-4480-ab2d-67fc27c64ce3 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:08.743010 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-6c5c4a64-627c-4480-ab2d-67fc27c64ce3 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a" status: 200 len: 1734 microversion: 2.1 time: 0.166022 May 26 12:50:08.743597 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 216/431] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:50:08 2022] GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a => generated 1734 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:08.753481 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-2e79e2aa-50d8-4f25-9d48-fdea054e2d4c tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:08.753481 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-2e79e2aa-50d8-4f25-9d48-fdea054e2d4c tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] [instance: 4d941693-7aca-4eb9-b1eb-5add0d24b5c1] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:08.761015 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-2e79e2aa-50d8-4f25-9d48-fdea054e2d4c tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:08.761616 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-2e79e2aa-50d8-4f25-9d48-fdea054e2d4c tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:08.762645 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-2e79e2aa-50d8-4f25-9d48-fdea054e2d4c tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:08.763304 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-2e79e2aa-50d8-4f25-9d48-fdea054e2d4c tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:08.768982 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-9b2f3e6e-5a25-4e3f-a852-1807312642b1 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0537911b91184fcdbdcc9e93ec3fe5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad768b45d17480d8d6bbbcff6032c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:08.784633 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-9b2f3e6e-5a25-4e3f-a852-1807312642b1 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "GET /compute/v2.1/servers/1a852e3a-0d2b-470a-a429-b4bac6aa8e6b" status: 200 len: 1679 microversion: 2.1 time: 0.176889 May 26 12:50:08.789983 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 216/432] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:50:08 2022] GET /compute/v2.1/servers/1a852e3a-0d2b-470a-a429-b4bac6aa8e6b => generated 1679 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:50:08.913270 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-2e79e2aa-50d8-4f25-9d48-fdea054e2d4c tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646a9abb1f9d4a1295a04defd895ff7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd539dfec943a44eb9b025d842a1f858d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:08.921467 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-2e79e2aa-50d8-4f25-9d48-fdea054e2d4c tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] 10.222.0.41 "GET /compute/v2.1/servers/4d941693-7aca-4eb9-b1eb-5add0d24b5c1" status: 200 len: 1319 microversion: 2.1 time: 0.175630 May 26 12:50:08.922074 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 217/433] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:50:08 2022] GET /compute/v2.1/servers/4d941693-7aca-4eb9-b1eb-5add0d24b5c1 => generated 1319 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:09.761541 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-13e2bf50-455f-4711-9b19-1fad19267e20 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:09.763012 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-13e2bf50-455f-4711-9b19-1fad19267e20 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: 7aa85144-0ebe-430c-b9e5-9b656ea4560a] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:09.770768 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-13e2bf50-455f-4711-9b19-1fad19267e20 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:09.771147 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-13e2bf50-455f-4711-9b19-1fad19267e20 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:09.771950 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-13e2bf50-455f-4711-9b19-1fad19267e20 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:09.772388 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-13e2bf50-455f-4711-9b19-1fad19267e20 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:09.801516 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-b3768ed5-074a-4414-9230-b20b52bdc7b1 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:09.802415 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-b3768ed5-074a-4414-9230-b20b52bdc7b1 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: 1a852e3a-0d2b-470a-a429-b4bac6aa8e6b] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:09.815721 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-b3768ed5-074a-4414-9230-b20b52bdc7b1 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:09.816160 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-b3768ed5-074a-4414-9230-b20b52bdc7b1 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:09.816938 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-b3768ed5-074a-4414-9230-b20b52bdc7b1 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:09.817371 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-b3768ed5-074a-4414-9230-b20b52bdc7b1 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:09.991620 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-13e2bf50-455f-4711-9b19-1fad19267e20 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:10.019249 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-13e2bf50-455f-4711-9b19-1fad19267e20 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a" status: 200 len: 1734 microversion: 2.1 time: 0.262318 May 26 12:50:10.020118 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 217/434] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:50:09 2022] GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a => generated 1734 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:10.034521 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [req-8d5d5a20-4a65-4dc1-84b0-5555a1154ab7 req-e1991e9b-5684-4ec1-a511-8a0c88287f25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d941693-7aca-4eb9-b1eb-5add0d24b5c1", "name": "network-vif-plugged", "status": "completed", "tag": "efe77520-8c46-4866-b802-5b04f9dea304"}]} {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:50:10.045855 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [req-8d5d5a20-4a65-4dc1-84b0-5555a1154ab7 req-e1991e9b-5684-4ec1-a511-8a0c88287f25 service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:10.046305 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [req-8d5d5a20-4a65-4dc1-84b0-5555a1154ab7 req-e1991e9b-5684-4ec1-a511-8a0c88287f25 service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:10.076632 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.compute.server_external_events [req-8d5d5a20-4a65-4dc1-84b0-5555a1154ab7 req-e1991e9b-5684-4ec1-a511-8a0c88287f25 service nova] Creating event network-vif-plugged:efe77520-8c46-4866-b802-5b04f9dea304 for instance 4d941693-7aca-4eb9-b1eb-5add0d24b5c1 on hv-cinder-81571 May 26 12:50:10.082435 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [req-8d5d5a20-4a65-4dc1-84b0-5555a1154ab7 req-e1991e9b-5684-4ec1-a511-8a0c88287f25 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052111 May 26 12:50:10.088064 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 218/435] 10.222.0.41 () {64 vars in 1317 bytes} [Thu May 26 12:50:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:50:10.094462 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-88d61ead-1a6f-4bef-bad7-8b87f83d00da tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:10.095190 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-88d61ead-1a6f-4bef-bad7-8b87f83d00da tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] [instance: 4d941693-7aca-4eb9-b1eb-5add0d24b5c1] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:10.103364 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-88d61ead-1a6f-4bef-bad7-8b87f83d00da tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:10.104018 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-88d61ead-1a6f-4bef-bad7-8b87f83d00da tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:10.104826 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-88d61ead-1a6f-4bef-bad7-8b87f83d00da tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:10.105272 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-88d61ead-1a6f-4bef-bad7-8b87f83d00da tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:10.119250 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-b3768ed5-074a-4414-9230-b20b52bdc7b1 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0537911b91184fcdbdcc9e93ec3fe5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad768b45d17480d8d6bbbcff6032c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:10.131779 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-b3768ed5-074a-4414-9230-b20b52bdc7b1 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "GET /compute/v2.1/servers/1a852e3a-0d2b-470a-a429-b4bac6aa8e6b" status: 200 len: 1679 microversion: 2.1 time: 0.334537 May 26 12:50:10.133170 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 218/436] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:50:09 2022] GET /compute/v2.1/servers/1a852e3a-0d2b-470a-a429-b4bac6aa8e6b => generated 1679 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:50:10.264627 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-88d61ead-1a6f-4bef-bad7-8b87f83d00da tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646a9abb1f9d4a1295a04defd895ff7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd539dfec943a44eb9b025d842a1f858d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:10.272718 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-88d61ead-1a6f-4bef-bad7-8b87f83d00da tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] 10.222.0.41 "GET /compute/v2.1/servers/4d941693-7aca-4eb9-b1eb-5add0d24b5c1" status: 200 len: 1319 microversion: 2.1 time: 0.182538 May 26 12:50:10.277896 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 219/437] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:50:10 2022] GET /compute/v2.1/servers/4d941693-7aca-4eb9-b1eb-5add0d24b5c1 => generated 1319 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:10.832414 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [req-a8a43610-d0d6-496b-b292-e189a4bbd14e req-782c5458-9bfd-4fa8-b18a-a13fbf8db688 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a852e3a-0d2b-470a-a429-b4bac6aa8e6b", "name": "network-vif-deleted", "tag": "3cc1e56f-c372-4659-9acb-1c70403e8a78"}]} {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:50:10.842781 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [req-a8a43610-d0d6-496b-b292-e189a4bbd14e req-782c5458-9bfd-4fa8-b18a-a13fbf8db688 service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:10.843510 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [req-a8a43610-d0d6-496b-b292-e189a4bbd14e req-782c5458-9bfd-4fa8-b18a-a13fbf8db688 service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:10.856665 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.compute.server_external_events [req-a8a43610-d0d6-496b-b292-e189a4bbd14e req-782c5458-9bfd-4fa8-b18a-a13fbf8db688 service nova] Creating event network-vif-deleted:3cc1e56f-c372-4659-9acb-1c70403e8a78 for instance 1a852e3a-0d2b-470a-a429-b4bac6aa8e6b on hv-cinder-81571 May 26 12:50:10.862301 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [req-a8a43610-d0d6-496b-b292-e189a4bbd14e req-782c5458-9bfd-4fa8-b18a-a13fbf8db688 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033953 May 26 12:50:10.867952 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 219/438] 10.222.0.41 () {64 vars in 1317 bytes} [Thu May 26 12:50:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:50:11.038813 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-b0031629-dd16-47e5-ac63-8c41c444ab95 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:11.040777 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-b0031629-dd16-47e5-ac63-8c41c444ab95 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: 7aa85144-0ebe-430c-b9e5-9b656ea4560a] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:11.050036 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-b0031629-dd16-47e5-ac63-8c41c444ab95 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:11.051729 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-b0031629-dd16-47e5-ac63-8c41c444ab95 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:11.055470 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-b0031629-dd16-47e5-ac63-8c41c444ab95 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:11.056052 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-b0031629-dd16-47e5-ac63-8c41c444ab95 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:11.154281 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-b5911706-998b-4faf-90af-d743d42f8536 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:11.154281 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-b5911706-998b-4faf-90af-d743d42f8536 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: 1a852e3a-0d2b-470a-a429-b4bac6aa8e6b] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:11.166872 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-b5911706-998b-4faf-90af-d743d42f8536 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:11.167603 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-b5911706-998b-4faf-90af-d743d42f8536 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:11.168559 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-b5911706-998b-4faf-90af-d743d42f8536 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:11.169294 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-b5911706-998b-4faf-90af-d743d42f8536 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:11.252955 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-b0031629-dd16-47e5-ac63-8c41c444ab95 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:11.263093 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-b0031629-dd16-47e5-ac63-8c41c444ab95 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a" status: 200 len: 1734 microversion: 2.1 time: 0.229888 May 26 12:50:11.264572 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 220/439] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:50:11 2022] GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a => generated 1734 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:11.290344 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-b5911706-998b-4faf-90af-d743d42f8536 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0537911b91184fcdbdcc9e93ec3fe5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad768b45d17480d8d6bbbcff6032c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:11.292486 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-95fdd5f0-ecd7-4105-a975-781d1019dbcd tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:11.297481 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-95fdd5f0-ecd7-4105-a975-781d1019dbcd tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] [instance: 4d941693-7aca-4eb9-b1eb-5add0d24b5c1] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:11.299269 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-b5911706-998b-4faf-90af-d743d42f8536 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "GET /compute/v2.1/servers/1a852e3a-0d2b-470a-a429-b4bac6aa8e6b" status: 200 len: 1326 microversion: 2.1 time: 0.153232 May 26 12:50:11.299723 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-95fdd5f0-ecd7-4105-a975-781d1019dbcd tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:11.300182 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-95fdd5f0-ecd7-4105-a975-781d1019dbcd tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:11.300956 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-95fdd5f0-ecd7-4105-a975-781d1019dbcd tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:11.301720 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-95fdd5f0-ecd7-4105-a975-781d1019dbcd tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:11.310091 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 220/440] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:50:11 2022] GET /compute/v2.1/servers/1a852e3a-0d2b-470a-a429-b4bac6aa8e6b => generated 1326 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:50:11.449655 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-95fdd5f0-ecd7-4105-a975-781d1019dbcd tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646a9abb1f9d4a1295a04defd895ff7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd539dfec943a44eb9b025d842a1f858d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:11.458336 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-95fdd5f0-ecd7-4105-a975-781d1019dbcd tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] 10.222.0.41 "GET /compute/v2.1/servers/4d941693-7aca-4eb9-b1eb-5add0d24b5c1" status: 200 len: 1319 microversion: 2.1 time: 0.171013 May 26 12:50:11.458931 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 221/441] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:50:11 2022] GET /compute/v2.1/servers/4d941693-7aca-4eb9-b1eb-5add0d24b5c1 => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:50:12.281192 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-60c8f994-9a51-4284-880f-bca9f55c5478 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:12.281838 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-60c8f994-9a51-4284-880f-bca9f55c5478 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: 7aa85144-0ebe-430c-b9e5-9b656ea4560a] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:12.288400 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-60c8f994-9a51-4284-880f-bca9f55c5478 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:12.288846 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-60c8f994-9a51-4284-880f-bca9f55c5478 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:12.290205 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-60c8f994-9a51-4284-880f-bca9f55c5478 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:12.290640 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-60c8f994-9a51-4284-880f-bca9f55c5478 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:12.317074 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-ae26bb2b-e767-4939-a050-cfaaa2235fd2 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:12.317794 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-ae26bb2b-e767-4939-a050-cfaaa2235fd2 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: 1a852e3a-0d2b-470a-a429-b4bac6aa8e6b] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:12.324391 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-ae26bb2b-e767-4939-a050-cfaaa2235fd2 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:12.324841 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-ae26bb2b-e767-4939-a050-cfaaa2235fd2 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:12.326948 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-ae26bb2b-e767-4939-a050-cfaaa2235fd2 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:12.327522 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-ae26bb2b-e767-4939-a050-cfaaa2235fd2 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:12.363136 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-ae26bb2b-e767-4939-a050-cfaaa2235fd2 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:12.363591 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-ae26bb2b-e767-4939-a050-cfaaa2235fd2 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:12.368354 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.objects.instance [None req-ae26bb2b-e767-4939-a050-cfaaa2235fd2 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lazy-loading 'fault' on Instance uuid 1a852e3a-0d2b-470a-a429-b4bac6aa8e6b {{(pid=124823) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:50:12.420335 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-ae26bb2b-e767-4939-a050-cfaaa2235fd2 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0537911b91184fcdbdcc9e93ec3fe5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad768b45d17480d8d6bbbcff6032c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:12.428102 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-ae26bb2b-e767-4939-a050-cfaaa2235fd2 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "GET /compute/v2.1/servers/1a852e3a-0d2b-470a-a429-b4bac6aa8e6b" status: 200 len: 1331 microversion: 2.1 time: 0.115459 May 26 12:50:12.428765 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 222/442] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:50:12 2022] GET /compute/v2.1/servers/1a852e3a-0d2b-470a-a429-b4bac6aa8e6b => generated 1331 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:50:12.444668 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-60c8f994-9a51-4284-880f-bca9f55c5478 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:12.454197 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-60c8f994-9a51-4284-880f-bca9f55c5478 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a" status: 200 len: 1734 microversion: 2.1 time: 0.176713 May 26 12:50:12.454786 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 221/443] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:50:12 2022] GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a => generated 1734 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:12.479368 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-c9718b0e-1b29-41ee-ad75-aedea4a20576 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:12.480119 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-c9718b0e-1b29-41ee-ad75-aedea4a20576 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] [instance: 4d941693-7aca-4eb9-b1eb-5add0d24b5c1] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:12.486247 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-c9718b0e-1b29-41ee-ad75-aedea4a20576 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:12.486700 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-c9718b0e-1b29-41ee-ad75-aedea4a20576 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:12.487671 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-c9718b0e-1b29-41ee-ad75-aedea4a20576 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:12.487909 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-c9718b0e-1b29-41ee-ad75-aedea4a20576 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:12.628165 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-c9718b0e-1b29-41ee-ad75-aedea4a20576 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646a9abb1f9d4a1295a04defd895ff7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd539dfec943a44eb9b025d842a1f858d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:12.635887 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-c9718b0e-1b29-41ee-ad75-aedea4a20576 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] 10.222.0.41 "GET /compute/v2.1/servers/4d941693-7aca-4eb9-b1eb-5add0d24b5c1" status: 200 len: 1508 microversion: 2.1 time: 0.161128 May 26 12:50:12.636441 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 223/444] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:50:12 2022] GET /compute/v2.1/servers/4d941693-7aca-4eb9-b1eb-5add0d24b5c1 => generated 1508 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:12.652827 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-9505ae6d-246c-42ff-bcbf-55afd7b094af tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "93b4d6bf-5c32-4e4e-bb86-cd2944cd445f", "device": "/dev/sdb"}} {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:50:12.654572 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-9505ae6d-246c-42ff-bcbf-55afd7b094af tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] [instance: 4d941693-7aca-4eb9-b1eb-5add0d24b5c1] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:12.660956 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-9505ae6d-246c-42ff-bcbf-55afd7b094af tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:12.661412 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-9505ae6d-246c-42ff-bcbf-55afd7b094af tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:12.662213 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-9505ae6d-246c-42ff-bcbf-55afd7b094af tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:12.662646 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-9505ae6d-246c-42ff-bcbf-55afd7b094af tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:13.445971 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-0834b521-4cbc-4865-bc3f-1c495ed1e592 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:13.447212 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-0834b521-4cbc-4865-bc3f-1c495ed1e592 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: 1a852e3a-0d2b-470a-a429-b4bac6aa8e6b] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:13.454485 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-0834b521-4cbc-4865-bc3f-1c495ed1e592 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:13.454939 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-0834b521-4cbc-4865-bc3f-1c495ed1e592 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:13.456463 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-0834b521-4cbc-4865-bc3f-1c495ed1e592 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:13.456917 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-0834b521-4cbc-4865-bc3f-1c495ed1e592 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:13.473145 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.wsgi [None req-0834b521-4cbc-4865-bc3f-1c495ed1e592 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] HTTP exception thrown: Instance 1a852e3a-0d2b-470a-a429-b4bac6aa8e6b could not be found. May 26 12:50:13.475759 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-0834b521-4cbc-4865-bc3f-1c495ed1e592 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Request method failure captured: May 26 12:50:13.475759 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: request: GET /compute/v2.1/servers/1a852e3a-0d2b-470a-a429-b4bac6aa8e6b HTTP/1.1 May 26 12:50:13.475759 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Accept: application/json May 26 12:50:13.475759 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Accept-Encoding: identity May 26 12:50:13.475759 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Connection: close May 26 12:50:13.475759 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Content-Length: 0 May 26 12:50:13.475759 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Content-Type: application/json May 26 12:50:13.475759 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Host: 10.222.0.41 May 26 12:50:13.475759 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Openstack-System-Scope: None May 26 12:50:13.475759 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: User-Agent: python-urllib3/1.26.9 May 26 12:50:13.475759 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Auth-Token: gAAAAABij3aYTDT6d91IIen8MNgNrsA0ohBGn_dUC2tsponOFwNurwjlknBmFB36blSobobmDRibGa26en17LZfjuhgOSZiQsswJxea6OZWaEAKHfDkIbtu7XpKpGW-ZBZHCz2dZb9rYCBos_UyGkZJY7k8n757Ijkdz5EguRL9a0MDFor49yAU May 26 12:50:13.475759 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Domain-Id: None May 26 12:50:13.475759 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Domain-Name: None May 26 12:50:13.475759 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Identity-Status: Confirmed May 26 12:50:13.475759 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Is-Admin-Project: True May 26 12:50:13.475759 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Project-Domain-Id: default May 26 12:50:13.475759 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Project-Domain-Name: Default May 26 12:50:13.475759 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Project-Id: cad768b45d17480d8d6bbbcff6032c8d May 26 12:50:13.475759 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Project-Name: tempest-AttachVolumeNegativeTest-155076248 May 26 12:50:13.475759 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Role: member,reader May 26 12:50:13.475759 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Roles: member,reader May 26 12:50:13.478734 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/cad768b45d17480d8d6bbbcff6032c8d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/cad768b45d17480d8d6bbbcff6032c8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/cad768b45d17480d8d6bbbcff6032c8d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_cad768b45d17480d8d6bbbcff6032c8d", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 26 12:50:13.478734 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Tenant: tempest-AttachVolumeNegativeTest-155076248 May 26 12:50:13.478734 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Tenant-Id: cad768b45d17480d8d6bbbcff6032c8d May 26 12:50:13.478734 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-155076248 May 26 12:50:13.478734 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User: tempest-AttachVolumeNegativeTest-155076248-project May 26 12:50:13.478734 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User-Domain-Id: default May 26 12:50:13.478734 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User-Domain-Name: Default May 26 12:50:13.478734 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User-Id: 0537911b91184fcdbdcc9e93ec3fe5b9 May 26 12:50:13.478734 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User-Name: tempest-AttachVolumeNegativeTest-155076248-project May 26 12:50:13.478734 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: method: > May 26 12:50:13.478734 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: exception: Instance 1a852e3a-0d2b-470a-a429-b4bac6aa8e6b could not be found. May 26 12:50:13.478734 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: action_args: {'id': '1a852e3a-0d2b-470a-a429-b4bac6aa8e6b'} May 26 12:50:13.480168 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:50:13.480168 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:50:13.480168 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:50:13.480168 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:50:13.480168 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:50:13.480168 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:50:13.480168 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:50:13.480168 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:50:13.480168 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:50:13.480168 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:50:13.480168 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a852e3a-0d2b-470a-a429-b4bac6aa8e6b could not be found. May 26 12:50:13.480168 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:50:13.480168 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:50:13.480168 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:50:13.480168 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:50:13.480168 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:50:13.480168 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:50:13.480168 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:50:13.480168 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:50:13.480168 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:50:13.482816 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:50:13.482816 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 12:50:13.482816 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 12:50:13.482816 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:50:13.482816 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:50:13.482816 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:50:13.482816 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:50:13.482816 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a852e3a-0d2b-470a-a429-b4bac6aa8e6b could not be found. May 26 12:50:13.482816 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:50:13.482816 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:50:13.482816 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:50:13.482816 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:50:13.482816 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:50:13.482816 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:50:13.482816 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:50:13.482816 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:50:13.482816 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a852e3a-0d2b-470a-a429-b4bac6aa8e6b could not be found. May 26 12:50:13.482816 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:50:13.485211 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-0834b521-4cbc-4865-bc3f-1c495ed1e592 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Returning 404 to user: Instance 1a852e3a-0d2b-470a-a429-b4bac6aa8e6b could not be found. {{(pid=124823) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:50:13.485211 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-0834b521-4cbc-4865-bc3f-1c495ed1e592 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "GET /compute/v2.1/servers/1a852e3a-0d2b-470a-a429-b4bac6aa8e6b" status: 404 len: 111 microversion: 2.1 time: 0.036036 May 26 12:50:13.485211 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 224/445] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:50:13 2022] GET /compute/v2.1/servers/1a852e3a-0d2b-470a-a429-b4bac6aa8e6b => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 12:50:13.487163 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-9957358e-eea5-4ad5-ba84-6f038921f638 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:13.487740 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-9957358e-eea5-4ad5-ba84-6f038921f638 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: 7aa85144-0ebe-430c-b9e5-9b656ea4560a] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:13.494142 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-9957358e-eea5-4ad5-ba84-6f038921f638 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:13.494290 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-9957358e-eea5-4ad5-ba84-6f038921f638 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:13.495059 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-9957358e-eea5-4ad5-ba84-6f038921f638 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:13.495548 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-9957358e-eea5-4ad5-ba84-6f038921f638 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:13.627739 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-9957358e-eea5-4ad5-ba84-6f038921f638 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:13.637955 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-9957358e-eea5-4ad5-ba84-6f038921f638 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a" status: 200 len: 1734 microversion: 2.1 time: 0.154477 May 26 12:50:13.638570 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 225/446] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:50:13 2022] GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:13.643266 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-0d3ec13e-5f08-4080-8a3c-548b04465188 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '.version_select at 0x7f26a1fb48b0>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:13.801451 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-0d3ec13e-5f08-4080-8a3c-548b04465188 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-113748839" status: 202 len: 0 microversion: 2.1 time: 0.161817 May 26 12:50:13.802244 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 226/447] 10.222.0.41 () {58 vars in 1217 bytes} [Thu May 26 12:50:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-113748839 => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 12:50:13.914791 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-9505ae6d-246c-42ff-bcbf-55afd7b094af tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] 10.222.0.41 "POST /compute/v2.1/servers/4d941693-7aca-4eb9-b1eb-5add0d24b5c1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.266426 May 26 12:50:13.918797 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 222/448] 10.222.0.41 () {60 vars in 1322 bytes} [Thu May 26 12:50:12 2022] POST /compute/v2.1/servers/4d941693-7aca-4eb9-b1eb-5add0d24b5c1/os-volume_attachments => generated 194 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:50:14.655838 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-ad027c61-b917-435f-a8b7-00352d562a26 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:14.656557 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-ad027c61-b917-435f-a8b7-00352d562a26 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: 7aa85144-0ebe-430c-b9e5-9b656ea4560a] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:14.666987 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-ad027c61-b917-435f-a8b7-00352d562a26 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:14.667474 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-ad027c61-b917-435f-a8b7-00352d562a26 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:14.668252 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-ad027c61-b917-435f-a8b7-00352d562a26 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:14.668716 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-ad027c61-b917-435f-a8b7-00352d562a26 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:14.670337 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-c1a29067-ea44-4e88-94c8-b6b0bbc494e1 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Action: 'create', calling method: .version_select at 0x7f26a1f42430>, body: {"keypair": {"name": "tempest-keypair-1597628760", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOxkIcnSMSsC+tvBpPj5wMhz6NYpKexAIIjrOAomd2K8m0t3soxAuaLV44ZAxK4MHG3xgqHw9bb3d1R+Itin91t5t/IjBDPjKdRZ6xB++YaSYkoeUVYf3at3KqkITccVqw=="}} {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:50:14.685791 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.quota [None req-c1a29067-ea44-4e88-94c8-b6b0bbc494e1 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Getting quotas for project cad768b45d17480d8d6bbbcff6032c8d. Resources: {'key_pairs'} {{(pid=124824) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:50:14.689752 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.quota [None req-c1a29067-ea44-4e88-94c8-b6b0bbc494e1 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Getting quotas for user 0537911b91184fcdbdcc9e93ec3fe5b9 and project cad768b45d17480d8d6bbbcff6032c8d. Resources: {'key_pairs'} {{(pid=124824) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:50:14.781418 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-c1a29067-ea44-4e88-94c8-b6b0bbc494e1 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.115495 May 26 12:50:14.787953 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 223/449] 10.222.0.41 () {60 vars in 1158 bytes} [Thu May 26 12:50:14 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:50:14.813856 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-ad027c61-b917-435f-a8b7-00352d562a26 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:14.822901 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-ad027c61-b917-435f-a8b7-00352d562a26 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a" status: 200 len: 1734 microversion: 2.1 time: 0.171253 May 26 12:50:14.823499 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 227/450] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:50:14 2022] GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a => generated 1734 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:15.840216 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-df085c9f-25ef-434d-bc41-079f5a44581a tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:15.840945 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-df085c9f-25ef-434d-bc41-079f5a44581a tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: 7aa85144-0ebe-430c-b9e5-9b656ea4560a] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:15.849104 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-df085c9f-25ef-434d-bc41-079f5a44581a tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:15.849590 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-df085c9f-25ef-434d-bc41-079f5a44581a tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:15.855155 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-df085c9f-25ef-434d-bc41-079f5a44581a tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:15.855155 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-df085c9f-25ef-434d-bc41-079f5a44581a tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:16.004896 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-df085c9f-25ef-434d-bc41-079f5a44581a tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:16.013339 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-df085c9f-25ef-434d-bc41-079f5a44581a tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a" status: 200 len: 1734 microversion: 2.1 time: 0.176986 May 26 12:50:16.013951 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 224/451] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:50:15 2022] GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a => generated 1734 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:50:16.992551 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-f935e8d8-03df-4a6d-8136-e13e94aa33a2 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:16.993143 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-f935e8d8-03df-4a6d-8136-e13e94aa33a2 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 7ffbf048-2aa0-4656-a6cd-923b35031eaa] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:17.001721 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-f935e8d8-03df-4a6d-8136-e13e94aa33a2 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:17.002511 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-f935e8d8-03df-4a6d-8136-e13e94aa33a2 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:17.003339 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-f935e8d8-03df-4a6d-8136-e13e94aa33a2 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:17.003946 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-f935e8d8-03df-4a6d-8136-e13e94aa33a2 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:17.032826 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-ea4c3fdf-e47c-454b-ae4b-6e8db2d99bf6 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:17.033608 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-ea4c3fdf-e47c-454b-ae4b-6e8db2d99bf6 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: 7aa85144-0ebe-430c-b9e5-9b656ea4560a] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:17.033877 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-f935e8d8-03df-4a6d-8136-e13e94aa33a2 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa/os-volume_attachments/4af30dca-103f-40fc-a0a0-c3f58507c189" status: 200 len: 194 microversion: 2.20 time: 0.045669 May 26 12:50:17.040101 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 228/452] 10.222.0.41 () {60 vars in 1453 bytes} [Thu May 26 12:50:16 2022] GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa/os-volume_attachments/4af30dca-103f-40fc-a0a0-c3f58507c189 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 12:50:17.041391 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-ea4c3fdf-e47c-454b-ae4b-6e8db2d99bf6 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:17.042266 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-ea4c3fdf-e47c-454b-ae4b-6e8db2d99bf6 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:17.043076 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-ea4c3fdf-e47c-454b-ae4b-6e8db2d99bf6 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:17.043612 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-ea4c3fdf-e47c-454b-ae4b-6e8db2d99bf6 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:17.105476 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-18f0f1fe-19aa-4250-b866-2b06aa646fc1 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:17.106003 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-18f0f1fe-19aa-4250-b866-2b06aa646fc1 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 7ffbf048-2aa0-4656-a6cd-923b35031eaa] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:17.113068 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-18f0f1fe-19aa-4250-b866-2b06aa646fc1 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:17.113952 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-18f0f1fe-19aa-4250-b866-2b06aa646fc1 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:17.115297 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-18f0f1fe-19aa-4250-b866-2b06aa646fc1 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:17.116125 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-18f0f1fe-19aa-4250-b866-2b06aa646fc1 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:17.200553 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-ea4c3fdf-e47c-454b-ae4b-6e8db2d99bf6 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:17.204729 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.objects.instance [None req-18f0f1fe-19aa-4250-b866-2b06aa646fc1 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lazy-loading 'services' on Instance uuid 7ffbf048-2aa0-4656-a6cd-923b35031eaa {{(pid=124823) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:50:17.208027 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-ea4c3fdf-e47c-454b-ae4b-6e8db2d99bf6 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a" status: 200 len: 1734 microversion: 2.1 time: 0.181267 May 26 12:50:17.208609 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 225/453] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:50:17 2022] GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a => generated 1734 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:50:17.584880 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-18f0f1fe-19aa-4250-b866-2b06aa646fc1 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "DELETE /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa/os-volume_attachments/4af30dca-103f-40fc-a0a0-c3f58507c189" status: 202 len: 0 microversion: 2.20 time: 0.485506 May 26 12:50:17.585481 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 229/454] 10.222.0.41 () {60 vars in 1456 bytes} [Thu May 26 12:50:17 2022] DELETE /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa/os-volume_attachments/4af30dca-103f-40fc-a0a0-c3f58507c189 => generated 0 bytes in 487 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 26 12:50:17.596935 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-502fcb0a-65b2-4b72-b68b-b97ecfc289b9 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-862345453", "imageRef": "6df25342-b071-489b-a7c1-3089fa19af6d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fd8eb981-0241-4288-8206-05bf49eea8ea"}], "security_groups": [{"name": "tempest-securitygroup--434522197"}], "key_name": "tempest-keypair-1597628760", "user_data": "}} {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:50:17.597237 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-d8ca1cbd-13b7-4df1-a154-5fd19e3bbbcc tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:17.598626 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-d8ca1cbd-13b7-4df1-a154-5fd19e3bbbcc tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 7ffbf048-2aa0-4656-a6cd-923b35031eaa] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:17.608378 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-d8ca1cbd-13b7-4df1-a154-5fd19e3bbbcc tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:17.608878 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-d8ca1cbd-13b7-4df1-a154-5fd19e3bbbcc tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:17.609840 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-d8ca1cbd-13b7-4df1-a154-5fd19e3bbbcc tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:17.612600 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-d8ca1cbd-13b7-4df1-a154-5fd19e3bbbcc tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:17.647551 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-d8ca1cbd-13b7-4df1-a154-5fd19e3bbbcc tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054833 May 26 12:50:17.648114 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 230/455] 10.222.0.41 () {60 vars in 1342 bytes} [Thu May 26 12:50:17 2022] GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 12:50:17.701719 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.network.neutron [None req-502fcb0a-65b2-4b72-b68b-b97ecfc289b9 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] validate_networks() for [('fd8eb981-0241-4288-8206-05bf49eea8ea', None, None, None, None, None)] {{(pid=124824) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 12:50:18.225563 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-b2ed74f6-0954-4a8f-941d-b6b35af9bc7c tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:18.226442 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-b2ed74f6-0954-4a8f-941d-b6b35af9bc7c tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: 7aa85144-0ebe-430c-b9e5-9b656ea4560a] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:18.232962 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-b2ed74f6-0954-4a8f-941d-b6b35af9bc7c tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:18.233745 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-b2ed74f6-0954-4a8f-941d-b6b35af9bc7c tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:18.234628 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-b2ed74f6-0954-4a8f-941d-b6b35af9bc7c tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:18.235268 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-b2ed74f6-0954-4a8f-941d-b6b35af9bc7c tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:18.317027 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.virt.hardware [None req-502fcb0a-65b2-4b72-b68b-b97ecfc289b9 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Flavor limits 0:0:0 {{(pid=124824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 12:50:18.317495 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.virt.hardware [None req-502fcb0a-65b2-4b72-b68b-b97ecfc289b9 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Image limits 0:0:0 {{(pid=124824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 12:50:18.318591 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.virt.hardware [None req-502fcb0a-65b2-4b72-b68b-b97ecfc289b9 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Flavor pref 0:0:0 {{(pid=124824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 12:50:18.319016 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.virt.hardware [None req-502fcb0a-65b2-4b72-b68b-b97ecfc289b9 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Image pref 0:0:0 {{(pid=124824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 12:50:18.319463 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.virt.hardware [None req-502fcb0a-65b2-4b72-b68b-b97ecfc289b9 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 12:50:18.329260 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-502fcb0a-65b2-4b72-b68b-b97ecfc289b9 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:18.329735 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-502fcb0a-65b2-4b72-b68b-b97ecfc289b9 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:18.334654 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-502fcb0a-65b2-4b72-b68b-b97ecfc289b9 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:18.334654 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-502fcb0a-65b2-4b72-b68b-b97ecfc289b9 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:18.350488 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.quota [None req-502fcb0a-65b2-4b72-b68b-b97ecfc289b9 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Getting quotas for project cad768b45d17480d8d6bbbcff6032c8d. Resources: {'instances', 'ram', 'cores'} {{(pid=124824) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:50:18.354908 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.quota [None req-502fcb0a-65b2-4b72-b68b-b97ecfc289b9 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Getting quotas for user 0537911b91184fcdbdcc9e93ec3fe5b9 and project cad768b45d17480d8d6bbbcff6032c8d. Resources: {'instances', 'ram', 'cores'} {{(pid=124824) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:50:18.366543 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-502fcb0a-65b2-4b72-b68b-b97ecfc289b9 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Going to run 1 instances... {{(pid=124824) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 12:50:18.369031 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-502fcb0a-65b2-4b72-b68b-b97ecfc289b9 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: 1b2f404c-1ca9-4904-944c-16685c8f68c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6df25342-b071-489b-a7c1-3089fa19af6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124824) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 12:50:18.373178 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-b2ed74f6-0954-4a8f-941d-b6b35af9bc7c tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:18.381462 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-b2ed74f6-0954-4a8f-941d-b6b35af9bc7c tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a" status: 200 len: 1734 microversion: 2.1 time: 0.160347 May 26 12:50:18.382071 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 231/456] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:50:18 2022] GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a => generated 1734 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:50:18.396375 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG dbcounter [-] [124824] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=124824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:50:18.547753 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-502fcb0a-65b2-4b72-b68b-b97ecfc289b9 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.955062 May 26 12:50:18.548442 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 226/457] 10.222.0.41 () {60 vars in 1146 bytes} [Thu May 26 12:50:17 2022] POST /compute/v2.1/servers => generated 401 bytes in 957 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 12:50:18.560662 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-d4a72140-dccb-4676-a0db-3be529ab5d51 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:18.561358 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-d4a72140-dccb-4676-a0db-3be529ab5d51 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: 1b2f404c-1ca9-4904-944c-16685c8f68c5] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:18.615437 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-d4a72140-dccb-4676-a0db-3be529ab5d51 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0537911b91184fcdbdcc9e93ec3fe5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad768b45d17480d8d6bbbcff6032c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:18.622222 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-d4a72140-dccb-4676-a0db-3be529ab5d51 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "GET /compute/v2.1/servers/1b2f404c-1ca9-4904-944c-16685c8f68c5" status: 200 len: 1241 microversion: 2.1 time: 0.065756 May 26 12:50:18.622796 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 232/458] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:50:18 2022] GET /compute/v2.1/servers/1b2f404c-1ca9-4904-944c-16685c8f68c5 => generated 1241 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:18.660151 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-eba6f91f-5ead-4007-a375-5cc0b44cbc0f tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:18.661192 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-eba6f91f-5ead-4007-a375-5cc0b44cbc0f tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 7ffbf048-2aa0-4656-a6cd-923b35031eaa] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:18.670864 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-eba6f91f-5ead-4007-a375-5cc0b44cbc0f tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:18.671406 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-eba6f91f-5ead-4007-a375-5cc0b44cbc0f tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:18.672187 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-eba6f91f-5ead-4007-a375-5cc0b44cbc0f tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:18.672582 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-eba6f91f-5ead-4007-a375-5cc0b44cbc0f tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:18.702692 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-eba6f91f-5ead-4007-a375-5cc0b44cbc0f tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046936 May 26 12:50:18.703263 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 227/459] 10.222.0.41 () {60 vars in 1342 bytes} [Thu May 26 12:50:18 2022] GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 12:50:19.399728 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-e09962ed-0aac-43c0-932f-7a9a785f2e5c tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:19.400330 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-e09962ed-0aac-43c0-932f-7a9a785f2e5c tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: 7aa85144-0ebe-430c-b9e5-9b656ea4560a] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:19.407269 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-e09962ed-0aac-43c0-932f-7a9a785f2e5c tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:19.407714 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-e09962ed-0aac-43c0-932f-7a9a785f2e5c tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:19.408475 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-e09962ed-0aac-43c0-932f-7a9a785f2e5c tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:19.409000 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-e09962ed-0aac-43c0-932f-7a9a785f2e5c tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:19.415836 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG dbcounter [-] [124823] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:50:19.545197 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-e09962ed-0aac-43c0-932f-7a9a785f2e5c tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:19.553995 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-e09962ed-0aac-43c0-932f-7a9a785f2e5c tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a" status: 200 len: 1734 microversion: 2.1 time: 0.159202 May 26 12:50:19.554752 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 233/460] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:50:19 2022] GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a => generated 1734 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:19.640224 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-8c22b20e-816d-4d92-af90-4be34fe125eb tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:19.641018 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-8c22b20e-816d-4d92-af90-4be34fe125eb tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: 1b2f404c-1ca9-4904-944c-16685c8f68c5] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:19.648018 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-8c22b20e-816d-4d92-af90-4be34fe125eb tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:19.649035 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-8c22b20e-816d-4d92-af90-4be34fe125eb tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:19.649839 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-8c22b20e-816d-4d92-af90-4be34fe125eb tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:19.650280 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-8c22b20e-816d-4d92-af90-4be34fe125eb tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:19.654573 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG dbcounter [-] [124824] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:50:19.712968 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-8c22b20e-816d-4d92-af90-4be34fe125eb tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0537911b91184fcdbdcc9e93ec3fe5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad768b45d17480d8d6bbbcff6032c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:19.714978 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-dc6e9ecf-fbbe-41f6-aa4c-a5b85217f9df tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:19.716158 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-dc6e9ecf-fbbe-41f6-aa4c-a5b85217f9df tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 7ffbf048-2aa0-4656-a6cd-923b35031eaa] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:19.720466 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-8c22b20e-816d-4d92-af90-4be34fe125eb tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "GET /compute/v2.1/servers/1b2f404c-1ca9-4904-944c-16685c8f68c5" status: 200 len: 1245 microversion: 2.1 time: 0.084600 May 26 12:50:19.721048 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 228/461] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:50:19 2022] GET /compute/v2.1/servers/1b2f404c-1ca9-4904-944c-16685c8f68c5 => generated 1245 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:19.722988 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-dc6e9ecf-fbbe-41f6-aa4c-a5b85217f9df tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:19.723715 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-dc6e9ecf-fbbe-41f6-aa4c-a5b85217f9df tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:19.724477 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-dc6e9ecf-fbbe-41f6-aa4c-a5b85217f9df tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:19.724908 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-dc6e9ecf-fbbe-41f6-aa4c-a5b85217f9df tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:19.755831 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-dc6e9ecf-fbbe-41f6-aa4c-a5b85217f9df tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045523 May 26 12:50:19.756411 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 234/462] 10.222.0.41 () {60 vars in 1342 bytes} [Thu May 26 12:50:19 2022] GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 12:50:20.577586 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-4b0d7582-d5e8-4c81-af3a-ea3843b0206e tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:20.578396 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-4b0d7582-d5e8-4c81-af3a-ea3843b0206e tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: 7aa85144-0ebe-430c-b9e5-9b656ea4560a] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:20.586202 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-4b0d7582-d5e8-4c81-af3a-ea3843b0206e tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:20.586847 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-4b0d7582-d5e8-4c81-af3a-ea3843b0206e tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:20.595022 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-4b0d7582-d5e8-4c81-af3a-ea3843b0206e tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:20.595022 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-4b0d7582-d5e8-4c81-af3a-ea3843b0206e tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:20.735351 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-4b0d7582-d5e8-4c81-af3a-ea3843b0206e tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:20.737933 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-f7e1491a-a71c-49cd-b502-91b410ae4061 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:20.738551 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-f7e1491a-a71c-49cd-b502-91b410ae4061 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: 1b2f404c-1ca9-4904-944c-16685c8f68c5] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:20.741959 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG dbcounter [-] [124823] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:50:20.743622 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-4b0d7582-d5e8-4c81-af3a-ea3843b0206e tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a" status: 200 len: 1734 microversion: 2.1 time: 0.173879 May 26 12:50:20.744204 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 229/463] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:50:20 2022] GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a => generated 1734 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:20.745898 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-f7e1491a-a71c-49cd-b502-91b410ae4061 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:20.746353 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-f7e1491a-a71c-49cd-b502-91b410ae4061 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:20.747135 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-f7e1491a-a71c-49cd-b502-91b410ae4061 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:20.755105 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-f7e1491a-a71c-49cd-b502-91b410ae4061 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:20.767981 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-c4788024-0e1e-4f93-b40d-f35962ef8c5c tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:20.768967 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-c4788024-0e1e-4f93-b40d-f35962ef8c5c tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 7ffbf048-2aa0-4656-a6cd-923b35031eaa] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:20.776296 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-c4788024-0e1e-4f93-b40d-f35962ef8c5c tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:20.776875 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-c4788024-0e1e-4f93-b40d-f35962ef8c5c tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:20.777346 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-c4788024-0e1e-4f93-b40d-f35962ef8c5c tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:20.777739 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-c4788024-0e1e-4f93-b40d-f35962ef8c5c tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:20.810781 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-c4788024-0e1e-4f93-b40d-f35962ef8c5c tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046601 May 26 12:50:20.811262 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 230/464] 10.222.0.41 () {60 vars in 1342 bytes} [Thu May 26 12:50:20 2022] GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 12:50:20.813042 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-f7e1491a-a71c-49cd-b502-91b410ae4061 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0537911b91184fcdbdcc9e93ec3fe5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad768b45d17480d8d6bbbcff6032c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:20.820760 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-f7e1491a-a71c-49cd-b502-91b410ae4061 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "GET /compute/v2.1/servers/1b2f404c-1ca9-4904-944c-16685c8f68c5" status: 200 len: 1293 microversion: 2.1 time: 0.086818 May 26 12:50:20.821457 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 235/465] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:50:20 2022] GET /compute/v2.1/servers/1b2f404c-1ca9-4904-944c-16685c8f68c5 => generated 1293 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:50:21.761276 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-c1837741-1048-407e-8b76-095facaf05da tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:21.762057 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-c1837741-1048-407e-8b76-095facaf05da tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: 7aa85144-0ebe-430c-b9e5-9b656ea4560a] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:21.769234 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-c1837741-1048-407e-8b76-095facaf05da tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:21.769697 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-c1837741-1048-407e-8b76-095facaf05da tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:21.772766 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-c1837741-1048-407e-8b76-095facaf05da tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:21.772766 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-c1837741-1048-407e-8b76-095facaf05da tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:21.824038 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-4a941970-77b6-45d7-b0c0-077403ddd776 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:21.825062 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-4a941970-77b6-45d7-b0c0-077403ddd776 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 7ffbf048-2aa0-4656-a6cd-923b35031eaa] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:21.831604 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-4a941970-77b6-45d7-b0c0-077403ddd776 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:21.832051 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-4a941970-77b6-45d7-b0c0-077403ddd776 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:21.832823 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-4a941970-77b6-45d7-b0c0-077403ddd776 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:21.833255 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-4a941970-77b6-45d7-b0c0-077403ddd776 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:21.865927 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-4a941970-77b6-45d7-b0c0-077403ddd776 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047354 May 26 12:50:21.866500 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 236/466] 10.222.0.41 () {60 vars in 1342 bytes} [Thu May 26 12:50:21 2022] GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 12:50:21.873720 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-4deb4611-8ed1-44be-8d22-dd43130dbd12 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:21.874332 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-4deb4611-8ed1-44be-8d22-dd43130dbd12 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: 1b2f404c-1ca9-4904-944c-16685c8f68c5] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:21.880614 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-4deb4611-8ed1-44be-8d22-dd43130dbd12 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:21.881055 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-4deb4611-8ed1-44be-8d22-dd43130dbd12 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:21.881834 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-4deb4611-8ed1-44be-8d22-dd43130dbd12 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:21.882588 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-4deb4611-8ed1-44be-8d22-dd43130dbd12 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:21.911840 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-c1837741-1048-407e-8b76-095facaf05da tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:21.931101 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-c1837741-1048-407e-8b76-095facaf05da tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a" status: 200 len: 1734 microversion: 2.1 time: 0.174403 May 26 12:50:21.931895 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 231/467] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:50:21 2022] GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a => generated 1734 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:21.952453 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-4deb4611-8ed1-44be-8d22-dd43130dbd12 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0537911b91184fcdbdcc9e93ec3fe5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad768b45d17480d8d6bbbcff6032c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:21.959811 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-4deb4611-8ed1-44be-8d22-dd43130dbd12 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "GET /compute/v2.1/servers/1b2f404c-1ca9-4904-944c-16685c8f68c5" status: 200 len: 1301 microversion: 2.1 time: 0.091787 May 26 12:50:21.960369 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 237/468] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:50:21 2022] GET /compute/v2.1/servers/1b2f404c-1ca9-4904-944c-16685c8f68c5 => generated 1301 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:22.878858 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-c5c9a2d7-bd3f-424d-a8b6-b2c328bd142c tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:22.879982 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-c5c9a2d7-bd3f-424d-a8b6-b2c328bd142c tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 7ffbf048-2aa0-4656-a6cd-923b35031eaa] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:22.893003 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-c5c9a2d7-bd3f-424d-a8b6-b2c328bd142c tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:22.894448 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-c5c9a2d7-bd3f-424d-a8b6-b2c328bd142c tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:22.895322 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-c5c9a2d7-bd3f-424d-a8b6-b2c328bd142c tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:22.895769 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-c5c9a2d7-bd3f-424d-a8b6-b2c328bd142c tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:22.930694 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-c5c9a2d7-bd3f-424d-a8b6-b2c328bd142c tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.056389 May 26 12:50:22.931724 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 232/469] 10.222.0.41 () {60 vars in 1342 bytes} [Thu May 26 12:50:22 2022] GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:22.949746 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-2d856a82-c052-4178-87f3-71ac9cd211ec tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:22.950364 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-2d856a82-c052-4178-87f3-71ac9cd211ec tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: 7aa85144-0ebe-430c-b9e5-9b656ea4560a] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:22.959543 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-2d856a82-c052-4178-87f3-71ac9cd211ec tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:22.959986 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-2d856a82-c052-4178-87f3-71ac9cd211ec tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:22.963176 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-2d856a82-c052-4178-87f3-71ac9cd211ec tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:22.964041 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-2d856a82-c052-4178-87f3-71ac9cd211ec tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:22.977630 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-031916fb-f9b5-46c8-908a-1b3302cfecd0 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:22.978494 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-031916fb-f9b5-46c8-908a-1b3302cfecd0 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: 1b2f404c-1ca9-4904-944c-16685c8f68c5] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:22.996541 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-031916fb-f9b5-46c8-908a-1b3302cfecd0 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:22.997173 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-031916fb-f9b5-46c8-908a-1b3302cfecd0 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:22.997980 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-031916fb-f9b5-46c8-908a-1b3302cfecd0 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:23.000108 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-031916fb-f9b5-46c8-908a-1b3302cfecd0 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:23.167892 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-2d856a82-c052-4178-87f3-71ac9cd211ec tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:23.176044 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-2d856a82-c052-4178-87f3-71ac9cd211ec tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a" status: 200 len: 1734 microversion: 2.1 time: 0.231066 May 26 12:50:23.179978 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 238/470] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:50:22 2022] GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a => generated 1734 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:23.181852 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-9daa4ca1-8255-467c-97c1-ab4e0dce7371 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:23.182346 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-9daa4ca1-8255-467c-97c1-ab4e0dce7371 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 7ffbf048-2aa0-4656-a6cd-923b35031eaa] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:23.188401 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-9daa4ca1-8255-467c-97c1-ab4e0dce7371 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:23.188852 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-9daa4ca1-8255-467c-97c1-ab4e0dce7371 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:23.189656 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-9daa4ca1-8255-467c-97c1-ab4e0dce7371 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:23.190151 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-9daa4ca1-8255-467c-97c1-ab4e0dce7371 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:23.218084 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-9daa4ca1-8255-467c-97c1-ab4e0dce7371 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 7ffbf048-2aa0-4656-a6cd-923b35031eaa] Going to try to terminate instance {{(pid=124823) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 12:50:23.263581 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-031916fb-f9b5-46c8-908a-1b3302cfecd0 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0537911b91184fcdbdcc9e93ec3fe5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad768b45d17480d8d6bbbcff6032c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:23.271316 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-031916fb-f9b5-46c8-908a-1b3302cfecd0 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "GET /compute/v2.1/servers/1b2f404c-1ca9-4904-944c-16685c8f68c5" status: 200 len: 1366 microversion: 2.1 time: 0.298655 May 26 12:50:23.272100 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 233/471] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:50:22 2022] GET /compute/v2.1/servers/1b2f404c-1ca9-4904-944c-16685c8f68c5 => generated 1366 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:23.524338 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-9daa4ca1-8255-467c-97c1-ab4e0dce7371 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "DELETE /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa" status: 204 len: 0 microversion: 2.20 time: 0.346432 May 26 12:50:23.525041 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 239/472] 10.222.0.41 () {60 vars in 1279 bytes} [Thu May 26 12:50:23 2022] DELETE /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa => generated 0 bytes in 348 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 26 12:50:23.540424 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-6a9aa3a4-d41e-4cc9-8acd-54b689b59a49 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:23.541035 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-6a9aa3a4-d41e-4cc9-8acd-54b689b59a49 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 7ffbf048-2aa0-4656-a6cd-923b35031eaa] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:23.547144 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-6a9aa3a4-d41e-4cc9-8acd-54b689b59a49 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:23.547596 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-6a9aa3a4-d41e-4cc9-8acd-54b689b59a49 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:23.548365 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-6a9aa3a4-d41e-4cc9-8acd-54b689b59a49 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:23.548834 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-6a9aa3a4-d41e-4cc9-8acd-54b689b59a49 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:23.752639 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-6a9aa3a4-d41e-4cc9-8acd-54b689b59a49 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:23.761584 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-6a9aa3a4-d41e-4cc9-8acd-54b689b59a49 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:23.763171 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-6a9aa3a4-d41e-4cc9-8acd-54b689b59a49 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:23.764380 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-6a9aa3a4-d41e-4cc9-8acd-54b689b59a49 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa" status: 200 len: 1723 microversion: 2.20 time: 0.228292 May 26 12:50:23.765649 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 234/473] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:50:23 2022] GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa => generated 1723 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:50:24.016215 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [req-98436512-c80d-470e-9291-49034930dfb4 req-5151cd2d-fe97-4891-b3df-9de4eb6aec25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b2f404c-1ca9-4904-944c-16685c8f68c5", "tag": "a3a568a1-60df-415d-9fd4-02eab3f0bfce"}]} {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:50:24.038524 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [req-98436512-c80d-470e-9291-49034930dfb4 req-5151cd2d-fe97-4891-b3df-9de4eb6aec25 service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:24.039504 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [req-98436512-c80d-470e-9291-49034930dfb4 req-5151cd2d-fe97-4891-b3df-9de4eb6aec25 service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:24.053423 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.compute.server_external_events [req-98436512-c80d-470e-9291-49034930dfb4 req-5151cd2d-fe97-4891-b3df-9de4eb6aec25 service nova] Creating event network-changed:a3a568a1-60df-415d-9fd4-02eab3f0bfce for instance 1b2f404c-1ca9-4904-944c-16685c8f68c5 on hv-cinder-81571 May 26 12:50:24.060611 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [req-98436512-c80d-470e-9291-49034930dfb4 req-5151cd2d-fe97-4891-b3df-9de4eb6aec25 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048958 May 26 12:50:24.061218 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 240/474] 10.222.0.41 () {64 vars in 1317 bytes} [Thu May 26 12:50:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:50:24.193317 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-2bb65e17-840e-45e1-ad4c-d8a67b1d4469 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:24.193967 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-2bb65e17-840e-45e1-ad4c-d8a67b1d4469 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: 7aa85144-0ebe-430c-b9e5-9b656ea4560a] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:24.201082 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-2bb65e17-840e-45e1-ad4c-d8a67b1d4469 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:24.201525 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-2bb65e17-840e-45e1-ad4c-d8a67b1d4469 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:24.202314 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-2bb65e17-840e-45e1-ad4c-d8a67b1d4469 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:24.202756 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-2bb65e17-840e-45e1-ad4c-d8a67b1d4469 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:24.290505 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-b0c95c63-52bc-4fe1-b9c4-639adc87c1ec tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:24.291295 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-b0c95c63-52bc-4fe1-b9c4-639adc87c1ec tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: 1b2f404c-1ca9-4904-944c-16685c8f68c5] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:24.298093 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-b0c95c63-52bc-4fe1-b9c4-639adc87c1ec tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:24.298575 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-b0c95c63-52bc-4fe1-b9c4-639adc87c1ec tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:24.299581 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-b0c95c63-52bc-4fe1-b9c4-639adc87c1ec tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:24.299781 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-b0c95c63-52bc-4fe1-b9c4-639adc87c1ec tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:24.332077 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-2bb65e17-840e-45e1-ad4c-d8a67b1d4469 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:24.340642 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-2bb65e17-840e-45e1-ad4c-d8a67b1d4469 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a" status: 200 len: 1734 microversion: 2.1 time: 0.151129 May 26 12:50:24.341217 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 235/475] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:50:24 2022] GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:24.425191 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-b0c95c63-52bc-4fe1-b9c4-639adc87c1ec tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0537911b91184fcdbdcc9e93ec3fe5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad768b45d17480d8d6bbbcff6032c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:24.433025 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-b0c95c63-52bc-4fe1-b9c4-639adc87c1ec tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "GET /compute/v2.1/servers/1b2f404c-1ca9-4904-944c-16685c8f68c5" status: 200 len: 1366 microversion: 2.1 time: 0.146806 May 26 12:50:24.433583 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 241/476] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:50:24 2022] GET /compute/v2.1/servers/1b2f404c-1ca9-4904-944c-16685c8f68c5 => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:50:24.784499 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-fe34c5d5-9ad2-426e-b340-85f5fa741c60 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:24.785107 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-fe34c5d5-9ad2-426e-b340-85f5fa741c60 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 7ffbf048-2aa0-4656-a6cd-923b35031eaa] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:24.791928 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-fe34c5d5-9ad2-426e-b340-85f5fa741c60 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:24.792382 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-fe34c5d5-9ad2-426e-b340-85f5fa741c60 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:24.793147 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-fe34c5d5-9ad2-426e-b340-85f5fa741c60 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:24.793583 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-fe34c5d5-9ad2-426e-b340-85f5fa741c60 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:24.919351 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-fe34c5d5-9ad2-426e-b340-85f5fa741c60 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:24.927214 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-fe34c5d5-9ad2-426e-b340-85f5fa741c60 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:24.928711 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-fe34c5d5-9ad2-426e-b340-85f5fa741c60 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:24.930659 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-fe34c5d5-9ad2-426e-b340-85f5fa741c60 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa" status: 200 len: 1723 microversion: 2.20 time: 0.150069 May 26 12:50:24.931222 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 236/477] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:50:24 2022] GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:50:25.357285 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-233cf0b7-f7c2-4d81-abb7-824010638db1 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:25.357926 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-233cf0b7-f7c2-4d81-abb7-824010638db1 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: 7aa85144-0ebe-430c-b9e5-9b656ea4560a] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:25.364424 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-233cf0b7-f7c2-4d81-abb7-824010638db1 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:25.364866 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-233cf0b7-f7c2-4d81-abb7-824010638db1 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:25.365614 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-233cf0b7-f7c2-4d81-abb7-824010638db1 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:25.366067 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-233cf0b7-f7c2-4d81-abb7-824010638db1 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:25.449641 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-ecd69e88-32f3-4380-906c-68f0e10ac902 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:25.450313 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-ecd69e88-32f3-4380-906c-68f0e10ac902 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: 1b2f404c-1ca9-4904-944c-16685c8f68c5] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:25.456423 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-ecd69e88-32f3-4380-906c-68f0e10ac902 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:25.457018 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-ecd69e88-32f3-4380-906c-68f0e10ac902 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:25.457620 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-ecd69e88-32f3-4380-906c-68f0e10ac902 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:25.458186 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-ecd69e88-32f3-4380-906c-68f0e10ac902 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:25.515585 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-233cf0b7-f7c2-4d81-abb7-824010638db1 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:25.518420 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-233cf0b7-f7c2-4d81-abb7-824010638db1 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a" status: 200 len: 1734 microversion: 2.1 time: 0.164927 May 26 12:50:25.518994 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 242/478] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:50:25 2022] GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a => generated 1734 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:25.608432 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-ecd69e88-32f3-4380-906c-68f0e10ac902 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0537911b91184fcdbdcc9e93ec3fe5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad768b45d17480d8d6bbbcff6032c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:25.615704 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-ecd69e88-32f3-4380-906c-68f0e10ac902 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "GET /compute/v2.1/servers/1b2f404c-1ca9-4904-944c-16685c8f68c5" status: 200 len: 1366 microversion: 2.1 time: 0.169916 May 26 12:50:25.616286 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 237/479] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:50:25 2022] GET /compute/v2.1/servers/1b2f404c-1ca9-4904-944c-16685c8f68c5 => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:50:25.949648 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-13b8cbc8-23dc-460c-a4a6-66aab25bcd6e tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:25.950227 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-13b8cbc8-23dc-460c-a4a6-66aab25bcd6e tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 7ffbf048-2aa0-4656-a6cd-923b35031eaa] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:25.956979 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-13b8cbc8-23dc-460c-a4a6-66aab25bcd6e tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:25.957424 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-13b8cbc8-23dc-460c-a4a6-66aab25bcd6e tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:25.958207 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-13b8cbc8-23dc-460c-a4a6-66aab25bcd6e tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:25.958636 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-13b8cbc8-23dc-460c-a4a6-66aab25bcd6e tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:26.090350 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-13b8cbc8-23dc-460c-a4a6-66aab25bcd6e tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:26.099256 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-13b8cbc8-23dc-460c-a4a6-66aab25bcd6e tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:26.100748 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-13b8cbc8-23dc-460c-a4a6-66aab25bcd6e tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:26.101938 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-13b8cbc8-23dc-460c-a4a6-66aab25bcd6e tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa" status: 200 len: 1723 microversion: 2.20 time: 0.156837 May 26 12:50:26.102502 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 243/480] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:50:25 2022] GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:50:26.535988 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-7730d1a0-c0b7-46d3-b26a-2ac8169ca9e7 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:26.536600 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-7730d1a0-c0b7-46d3-b26a-2ac8169ca9e7 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: 7aa85144-0ebe-430c-b9e5-9b656ea4560a] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:26.543200 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-7730d1a0-c0b7-46d3-b26a-2ac8169ca9e7 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:26.543648 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-7730d1a0-c0b7-46d3-b26a-2ac8169ca9e7 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:26.544403 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-7730d1a0-c0b7-46d3-b26a-2ac8169ca9e7 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:26.544835 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-7730d1a0-c0b7-46d3-b26a-2ac8169ca9e7 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:26.632261 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-51ecbb0d-a130-44a7-bac3-ac6752cb93f2 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:26.632904 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-51ecbb0d-a130-44a7-bac3-ac6752cb93f2 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: 1b2f404c-1ca9-4904-944c-16685c8f68c5] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:26.639349 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-51ecbb0d-a130-44a7-bac3-ac6752cb93f2 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:26.639794 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-51ecbb0d-a130-44a7-bac3-ac6752cb93f2 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:26.640559 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-51ecbb0d-a130-44a7-bac3-ac6752cb93f2 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:26.640991 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-51ecbb0d-a130-44a7-bac3-ac6752cb93f2 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:26.674684 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-7730d1a0-c0b7-46d3-b26a-2ac8169ca9e7 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:26.683611 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-7730d1a0-c0b7-46d3-b26a-2ac8169ca9e7 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a" status: 200 len: 1734 microversion: 2.1 time: 0.151422 May 26 12:50:26.684208 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 238/481] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:50:26 2022] GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:26.769033 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-51ecbb0d-a130-44a7-bac3-ac6752cb93f2 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0537911b91184fcdbdcc9e93ec3fe5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad768b45d17480d8d6bbbcff6032c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:26.776941 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-51ecbb0d-a130-44a7-bac3-ac6752cb93f2 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "GET /compute/v2.1/servers/1b2f404c-1ca9-4904-944c-16685c8f68c5" status: 200 len: 1366 microversion: 2.1 time: 0.148491 May 26 12:50:26.777502 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 244/482] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:50:26 2022] GET /compute/v2.1/servers/1b2f404c-1ca9-4904-944c-16685c8f68c5 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:50:27.125776 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-1abbe5ce-2ecf-4ea1-970e-cfaabf268ffc tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:27.126523 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-1abbe5ce-2ecf-4ea1-970e-cfaabf268ffc tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 7ffbf048-2aa0-4656-a6cd-923b35031eaa] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:27.133071 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-1abbe5ce-2ecf-4ea1-970e-cfaabf268ffc tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:27.133518 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-1abbe5ce-2ecf-4ea1-970e-cfaabf268ffc tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:27.134311 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-1abbe5ce-2ecf-4ea1-970e-cfaabf268ffc tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:27.134743 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-1abbe5ce-2ecf-4ea1-970e-cfaabf268ffc tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:27.277976 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-1abbe5ce-2ecf-4ea1-970e-cfaabf268ffc tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:27.286555 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-1abbe5ce-2ecf-4ea1-970e-cfaabf268ffc tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:27.288083 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-1abbe5ce-2ecf-4ea1-970e-cfaabf268ffc tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:27.289400 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-1abbe5ce-2ecf-4ea1-970e-cfaabf268ffc tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa" status: 200 len: 1723 microversion: 2.20 time: 0.167512 May 26 12:50:27.290066 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 239/483] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:50:27 2022] GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:50:27.701196 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-906db076-c13e-470a-8dd1-edfca6948a54 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:27.701823 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-906db076-c13e-470a-8dd1-edfca6948a54 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: 7aa85144-0ebe-430c-b9e5-9b656ea4560a] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:27.708512 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-906db076-c13e-470a-8dd1-edfca6948a54 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:27.708954 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-906db076-c13e-470a-8dd1-edfca6948a54 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:27.709752 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-906db076-c13e-470a-8dd1-edfca6948a54 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:27.710185 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-906db076-c13e-470a-8dd1-edfca6948a54 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:27.793385 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-1ba471a1-c1ab-46a6-bbba-107583867535 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:27.794282 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-1ba471a1-c1ab-46a6-bbba-107583867535 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: 1b2f404c-1ca9-4904-944c-16685c8f68c5] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:27.801445 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-1ba471a1-c1ab-46a6-bbba-107583867535 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:27.802021 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-1ba471a1-c1ab-46a6-bbba-107583867535 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:27.802787 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-1ba471a1-c1ab-46a6-bbba-107583867535 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:27.803217 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-1ba471a1-c1ab-46a6-bbba-107583867535 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:27.846846 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-906db076-c13e-470a-8dd1-edfca6948a54 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:27.856137 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-906db076-c13e-470a-8dd1-edfca6948a54 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a" status: 200 len: 1734 microversion: 2.1 time: 0.158696 May 26 12:50:27.856718 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 245/484] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:50:27 2022] GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a => generated 1734 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:27.932944 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-1ba471a1-c1ab-46a6-bbba-107583867535 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0537911b91184fcdbdcc9e93ec3fe5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad768b45d17480d8d6bbbcff6032c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:27.940741 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-1ba471a1-c1ab-46a6-bbba-107583867535 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "GET /compute/v2.1/servers/1b2f404c-1ca9-4904-944c-16685c8f68c5" status: 200 len: 1366 microversion: 2.1 time: 0.151571 May 26 12:50:27.941313 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 240/485] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:50:27 2022] GET /compute/v2.1/servers/1b2f404c-1ca9-4904-944c-16685c8f68c5 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:50:28.310252 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-5e43928f-9fb2-4655-87aa-e7b40e4e91cd tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:28.311024 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-5e43928f-9fb2-4655-87aa-e7b40e4e91cd tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 7ffbf048-2aa0-4656-a6cd-923b35031eaa] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:28.317934 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-5e43928f-9fb2-4655-87aa-e7b40e4e91cd tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:28.318379 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-5e43928f-9fb2-4655-87aa-e7b40e4e91cd tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:28.319180 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-5e43928f-9fb2-4655-87aa-e7b40e4e91cd tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:28.319605 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-5e43928f-9fb2-4655-87aa-e7b40e4e91cd tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:28.446943 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-5e43928f-9fb2-4655-87aa-e7b40e4e91cd tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:28.454890 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-5e43928f-9fb2-4655-87aa-e7b40e4e91cd tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:28.456503 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-5e43928f-9fb2-4655-87aa-e7b40e4e91cd tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:28.457640 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-5e43928f-9fb2-4655-87aa-e7b40e4e91cd tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa" status: 200 len: 1723 microversion: 2.20 time: 0.151998 May 26 12:50:28.458209 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 246/486] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:50:28 2022] GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:50:28.872916 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-6f3600d8-7916-4b0d-b5d2-f62955a37f9c tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:28.873532 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-6f3600d8-7916-4b0d-b5d2-f62955a37f9c tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: 7aa85144-0ebe-430c-b9e5-9b656ea4560a] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:28.875394 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG dbcounter [-] [124824] Writing DB stats nova_cell0:SELECT=2 {{(pid=124824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:50:28.876061 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG dbcounter [-] [124824] Writing DB stats nova_cell0:SELECT=10 {{(pid=124824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:50:28.881397 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-6f3600d8-7916-4b0d-b5d2-f62955a37f9c tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:28.882003 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-6f3600d8-7916-4b0d-b5d2-f62955a37f9c tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:28.882779 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-6f3600d8-7916-4b0d-b5d2-f62955a37f9c tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:28.883218 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-6f3600d8-7916-4b0d-b5d2-f62955a37f9c tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:28.958099 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-04b46c64-324f-40d5-a4e7-12cf0145f5ec tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:28.958703 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-04b46c64-324f-40d5-a4e7-12cf0145f5ec tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: 1b2f404c-1ca9-4904-944c-16685c8f68c5] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:28.962116 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG dbcounter [-] [124823] Writing DB stats nova_cell0:SELECT=2 {{(pid=124823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:50:28.967330 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-04b46c64-324f-40d5-a4e7-12cf0145f5ec tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:28.969379 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-04b46c64-324f-40d5-a4e7-12cf0145f5ec tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:28.969379 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-04b46c64-324f-40d5-a4e7-12cf0145f5ec tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:28.969379 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-04b46c64-324f-40d5-a4e7-12cf0145f5ec tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:29.060782 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-6f3600d8-7916-4b0d-b5d2-f62955a37f9c tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:29.068886 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-6f3600d8-7916-4b0d-b5d2-f62955a37f9c tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a" status: 200 len: 1734 microversion: 2.1 time: 0.199852 May 26 12:50:29.069467 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 241/487] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:50:28 2022] GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a => generated 1734 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:29.119135 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-04b46c64-324f-40d5-a4e7-12cf0145f5ec tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0537911b91184fcdbdcc9e93ec3fe5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad768b45d17480d8d6bbbcff6032c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:29.126678 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-04b46c64-324f-40d5-a4e7-12cf0145f5ec tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "GET /compute/v2.1/servers/1b2f404c-1ca9-4904-944c-16685c8f68c5" status: 200 len: 1366 microversion: 2.1 time: 0.173112 May 26 12:50:29.127244 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 247/488] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:50:28 2022] GET /compute/v2.1/servers/1b2f404c-1ca9-4904-944c-16685c8f68c5 => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:50:29.477008 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-15f99884-820c-4cc2-b201-2db84aea8424 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:29.477652 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-15f99884-820c-4cc2-b201-2db84aea8424 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 7ffbf048-2aa0-4656-a6cd-923b35031eaa] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:29.483668 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-15f99884-820c-4cc2-b201-2db84aea8424 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:29.484110 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-15f99884-820c-4cc2-b201-2db84aea8424 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:29.484862 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-15f99884-820c-4cc2-b201-2db84aea8424 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:29.485295 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-15f99884-820c-4cc2-b201-2db84aea8424 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:29.615854 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-15f99884-820c-4cc2-b201-2db84aea8424 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:29.624522 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-15f99884-820c-4cc2-b201-2db84aea8424 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:29.626139 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-15f99884-820c-4cc2-b201-2db84aea8424 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:29.627290 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-15f99884-820c-4cc2-b201-2db84aea8424 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa" status: 200 len: 1723 microversion: 2.20 time: 0.155151 May 26 12:50:29.627840 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 242/489] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:50:29 2022] GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:50:30.086650 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-0384653c-5151-44ae-80bf-49ec779196fa tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:30.087275 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-0384653c-5151-44ae-80bf-49ec779196fa tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: 7aa85144-0ebe-430c-b9e5-9b656ea4560a] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:30.094367 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-0384653c-5151-44ae-80bf-49ec779196fa tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:30.094872 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-0384653c-5151-44ae-80bf-49ec779196fa tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:30.095676 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-0384653c-5151-44ae-80bf-49ec779196fa tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:30.096113 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-0384653c-5151-44ae-80bf-49ec779196fa tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:30.143488 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-7812af5e-0d5f-44dc-b161-0a1d93bfb2c4 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:30.144099 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-7812af5e-0d5f-44dc-b161-0a1d93bfb2c4 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: 1b2f404c-1ca9-4904-944c-16685c8f68c5] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:30.151301 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-7812af5e-0d5f-44dc-b161-0a1d93bfb2c4 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:30.153891 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-7812af5e-0d5f-44dc-b161-0a1d93bfb2c4 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:30.153891 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-7812af5e-0d5f-44dc-b161-0a1d93bfb2c4 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:30.153891 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-7812af5e-0d5f-44dc-b161-0a1d93bfb2c4 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:30.224894 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-0384653c-5151-44ae-80bf-49ec779196fa tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:30.228406 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG dbcounter [-] [124823] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:50:30.233155 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-0384653c-5151-44ae-80bf-49ec779196fa tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a" status: 200 len: 1734 microversion: 2.1 time: 0.151130 May 26 12:50:30.233750 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 248/490] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:50:30 2022] GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:30.283068 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-7812af5e-0d5f-44dc-b161-0a1d93bfb2c4 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0537911b91184fcdbdcc9e93ec3fe5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad768b45d17480d8d6bbbcff6032c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:30.290551 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-7812af5e-0d5f-44dc-b161-0a1d93bfb2c4 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "GET /compute/v2.1/servers/1b2f404c-1ca9-4904-944c-16685c8f68c5" status: 200 len: 1366 microversion: 2.1 time: 0.150873 May 26 12:50:30.291121 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 243/491] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:50:30 2022] GET /compute/v2.1/servers/1b2f404c-1ca9-4904-944c-16685c8f68c5 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:50:30.646257 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-e2c2b22a-a38c-40c2-93c6-798c48c85572 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:30.646860 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-e2c2b22a-a38c-40c2-93c6-798c48c85572 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 7ffbf048-2aa0-4656-a6cd-923b35031eaa] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:30.653247 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-e2c2b22a-a38c-40c2-93c6-798c48c85572 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:30.653713 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-e2c2b22a-a38c-40c2-93c6-798c48c85572 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:30.654501 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-e2c2b22a-a38c-40c2-93c6-798c48c85572 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:30.654930 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-e2c2b22a-a38c-40c2-93c6-798c48c85572 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:30.783111 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-e2c2b22a-a38c-40c2-93c6-798c48c85572 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:30.791298 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-e2c2b22a-a38c-40c2-93c6-798c48c85572 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:30.792785 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-e2c2b22a-a38c-40c2-93c6-798c48c85572 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:30.793959 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-e2c2b22a-a38c-40c2-93c6-798c48c85572 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa" status: 200 len: 1723 microversion: 2.20 time: 0.152137 May 26 12:50:30.794514 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 249/492] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:50:30 2022] GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:50:31.250633 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-0a1f483e-13e1-4052-ad31-65aa5a4f3d6d tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:31.251242 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-0a1f483e-13e1-4052-ad31-65aa5a4f3d6d tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: 7aa85144-0ebe-430c-b9e5-9b656ea4560a] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:31.257816 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-0a1f483e-13e1-4052-ad31-65aa5a4f3d6d tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:31.258271 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-0a1f483e-13e1-4052-ad31-65aa5a4f3d6d tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:31.259027 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-0a1f483e-13e1-4052-ad31-65aa5a4f3d6d tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:31.259458 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-0a1f483e-13e1-4052-ad31-65aa5a4f3d6d tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:31.310878 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-9d3cb7de-ec35-4447-b07e-c281ece6b17c tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:31.311493 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-9d3cb7de-ec35-4447-b07e-c281ece6b17c tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: 1b2f404c-1ca9-4904-944c-16685c8f68c5] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:31.317609 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-9d3cb7de-ec35-4447-b07e-c281ece6b17c tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:31.318089 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-9d3cb7de-ec35-4447-b07e-c281ece6b17c tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:31.318852 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-9d3cb7de-ec35-4447-b07e-c281ece6b17c tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:31.319284 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-9d3cb7de-ec35-4447-b07e-c281ece6b17c tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:31.390410 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-0a1f483e-13e1-4052-ad31-65aa5a4f3d6d tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:31.393969 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG dbcounter [-] [124824] Writing DB stats nova_cell1:SELECT=100 {{(pid=124824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:50:31.398680 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-0a1f483e-13e1-4052-ad31-65aa5a4f3d6d tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a" status: 200 len: 1734 microversion: 2.1 time: 0.151998 May 26 12:50:31.399487 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 244/493] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:50:31 2022] GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:31.448728 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-9d3cb7de-ec35-4447-b07e-c281ece6b17c tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0537911b91184fcdbdcc9e93ec3fe5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad768b45d17480d8d6bbbcff6032c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:31.456372 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-9d3cb7de-ec35-4447-b07e-c281ece6b17c tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "GET /compute/v2.1/servers/1b2f404c-1ca9-4904-944c-16685c8f68c5" status: 200 len: 1366 microversion: 2.1 time: 0.150187 May 26 12:50:31.456899 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 250/494] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:50:31 2022] GET /compute/v2.1/servers/1b2f404c-1ca9-4904-944c-16685c8f68c5 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:50:31.812366 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-87eba369-7fe4-4e74-8a53-691f5818f1f8 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:31.812986 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-87eba369-7fe4-4e74-8a53-691f5818f1f8 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 7ffbf048-2aa0-4656-a6cd-923b35031eaa] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:31.819470 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-87eba369-7fe4-4e74-8a53-691f5818f1f8 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:31.819918 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-87eba369-7fe4-4e74-8a53-691f5818f1f8 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:31.820667 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-87eba369-7fe4-4e74-8a53-691f5818f1f8 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:31.821099 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-87eba369-7fe4-4e74-8a53-691f5818f1f8 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:31.951019 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-87eba369-7fe4-4e74-8a53-691f5818f1f8 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:31.958903 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-87eba369-7fe4-4e74-8a53-691f5818f1f8 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:31.960909 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-87eba369-7fe4-4e74-8a53-691f5818f1f8 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:31.962084 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-87eba369-7fe4-4e74-8a53-691f5818f1f8 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa" status: 200 len: 1723 microversion: 2.20 time: 0.153572 May 26 12:50:31.962640 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 245/495] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:50:31 2022] GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:50:32.415731 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-c46db0aa-d485-43b8-ac77-9a59fcdbaa64 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:32.416341 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-c46db0aa-d485-43b8-ac77-9a59fcdbaa64 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: 7aa85144-0ebe-430c-b9e5-9b656ea4560a] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:32.422954 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-c46db0aa-d485-43b8-ac77-9a59fcdbaa64 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:32.423404 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-c46db0aa-d485-43b8-ac77-9a59fcdbaa64 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:32.424169 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-c46db0aa-d485-43b8-ac77-9a59fcdbaa64 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:32.424605 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-c46db0aa-d485-43b8-ac77-9a59fcdbaa64 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:32.474016 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-0a9cc24f-7f68-4fde-bc9b-0a9a3cf414f1 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:32.474724 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-0a9cc24f-7f68-4fde-bc9b-0a9a3cf414f1 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: 1b2f404c-1ca9-4904-944c-16685c8f68c5] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:32.482715 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-0a9cc24f-7f68-4fde-bc9b-0a9a3cf414f1 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:32.483165 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-0a9cc24f-7f68-4fde-bc9b-0a9a3cf414f1 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:32.483938 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-0a9cc24f-7f68-4fde-bc9b-0a9a3cf414f1 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:32.484363 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-0a9cc24f-7f68-4fde-bc9b-0a9a3cf414f1 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:32.569038 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-c46db0aa-d485-43b8-ac77-9a59fcdbaa64 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:32.577573 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-c46db0aa-d485-43b8-ac77-9a59fcdbaa64 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a" status: 200 len: 1734 microversion: 2.1 time: 0.165704 May 26 12:50:32.578406 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 251/496] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:50:32 2022] GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a => generated 1734 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:32.626522 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-0a9cc24f-7f68-4fde-bc9b-0a9a3cf414f1 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0537911b91184fcdbdcc9e93ec3fe5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad768b45d17480d8d6bbbcff6032c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:32.634219 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-0a9cc24f-7f68-4fde-bc9b-0a9a3cf414f1 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "GET /compute/v2.1/servers/1b2f404c-1ca9-4904-944c-16685c8f68c5" status: 200 len: 1366 microversion: 2.1 time: 0.164335 May 26 12:50:32.634791 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 246/497] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:50:32 2022] GET /compute/v2.1/servers/1b2f404c-1ca9-4904-944c-16685c8f68c5 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:32.980678 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-9ef818f3-20fe-442b-87a7-3d925c4bfe10 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:32.981202 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-9ef818f3-20fe-442b-87a7-3d925c4bfe10 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 7ffbf048-2aa0-4656-a6cd-923b35031eaa] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:32.987276 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-9ef818f3-20fe-442b-87a7-3d925c4bfe10 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:32.987715 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-9ef818f3-20fe-442b-87a7-3d925c4bfe10 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:32.988509 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-9ef818f3-20fe-442b-87a7-3d925c4bfe10 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:32.989063 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-9ef818f3-20fe-442b-87a7-3d925c4bfe10 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:33.326982 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-9ef818f3-20fe-442b-87a7-3d925c4bfe10 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:33.334802 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-9ef818f3-20fe-442b-87a7-3d925c4bfe10 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:33.336883 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-9ef818f3-20fe-442b-87a7-3d925c4bfe10 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:33.338060 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-9ef818f3-20fe-442b-87a7-3d925c4bfe10 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa" status: 200 len: 1723 microversion: 2.20 time: 0.361989 May 26 12:50:33.338618 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 252/498] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:50:32 2022] GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa => generated 1723 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:50:33.595738 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-8694142a-408a-4165-a323-0243a5b75d1a tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:33.597256 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-8694142a-408a-4165-a323-0243a5b75d1a tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: 7aa85144-0ebe-430c-b9e5-9b656ea4560a] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:33.607285 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-8694142a-408a-4165-a323-0243a5b75d1a tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:33.607964 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-8694142a-408a-4165-a323-0243a5b75d1a tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:33.608746 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-8694142a-408a-4165-a323-0243a5b75d1a tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:33.609177 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-8694142a-408a-4165-a323-0243a5b75d1a tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:33.655838 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-75ac691e-a707-4392-850d-b27aa9d848dd tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:33.657179 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-75ac691e-a707-4392-850d-b27aa9d848dd tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: 1b2f404c-1ca9-4904-944c-16685c8f68c5] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:33.664890 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-75ac691e-a707-4392-850d-b27aa9d848dd tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:33.665619 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-75ac691e-a707-4392-850d-b27aa9d848dd tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:33.666617 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-75ac691e-a707-4392-850d-b27aa9d848dd tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:33.667236 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-75ac691e-a707-4392-850d-b27aa9d848dd tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:33.916948 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-8694142a-408a-4165-a323-0243a5b75d1a tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:33.924837 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-8694142a-408a-4165-a323-0243a5b75d1a tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a" status: 200 len: 1734 microversion: 2.1 time: 0.333856 May 26 12:50:33.925401 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 247/499] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:50:33 2022] GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a => generated 1734 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:33.926740 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-75ac691e-a707-4392-850d-b27aa9d848dd tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0537911b91184fcdbdcc9e93ec3fe5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad768b45d17480d8d6bbbcff6032c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:33.944498 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-75ac691e-a707-4392-850d-b27aa9d848dd tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "GET /compute/v2.1/servers/1b2f404c-1ca9-4904-944c-16685c8f68c5" status: 200 len: 1366 microversion: 2.1 time: 0.282281 May 26 12:50:33.944498 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 253/500] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:50:33 2022] GET /compute/v2.1/servers/1b2f404c-1ca9-4904-944c-16685c8f68c5 => generated 1366 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:34.361953 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-aaf014d3-8605-4086-9026-881480e56819 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:34.361953 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-aaf014d3-8605-4086-9026-881480e56819 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 7ffbf048-2aa0-4656-a6cd-923b35031eaa] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:34.365957 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-aaf014d3-8605-4086-9026-881480e56819 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:34.366404 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-aaf014d3-8605-4086-9026-881480e56819 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:34.367182 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-aaf014d3-8605-4086-9026-881480e56819 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:34.367621 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-aaf014d3-8605-4086-9026-881480e56819 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:34.502613 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-aaf014d3-8605-4086-9026-881480e56819 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:34.511904 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-aaf014d3-8605-4086-9026-881480e56819 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:34.513483 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-aaf014d3-8605-4086-9026-881480e56819 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:34.514733 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-aaf014d3-8605-4086-9026-881480e56819 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa" status: 200 len: 1723 microversion: 2.20 time: 0.161184 May 26 12:50:34.515490 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 248/501] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:50:34 2022] GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:50:34.773392 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [req-293ea224-e557-4149-856d-5fa0d78c003b req-01863fb4-0974-4212-9d86-516b7b8902cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ffbf048-2aa0-4656-a6cd-923b35031eaa", "name": "network-vif-deleted", "tag": "979ef417-a463-49c2-a7ae-7fae04d77dd9"}]} {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:50:34.783522 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [req-293ea224-e557-4149-856d-5fa0d78c003b req-01863fb4-0974-4212-9d86-516b7b8902cf service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:34.784224 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [req-293ea224-e557-4149-856d-5fa0d78c003b req-01863fb4-0974-4212-9d86-516b7b8902cf service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:34.795983 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.compute.server_external_events [req-293ea224-e557-4149-856d-5fa0d78c003b req-01863fb4-0974-4212-9d86-516b7b8902cf service nova] Creating event network-vif-deleted:979ef417-a463-49c2-a7ae-7fae04d77dd9 for instance 7ffbf048-2aa0-4656-a6cd-923b35031eaa on hv-cinder-81571 May 26 12:50:34.800985 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [req-293ea224-e557-4149-856d-5fa0d78c003b req-01863fb4-0974-4212-9d86-516b7b8902cf service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031240 May 26 12:50:34.801579 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 254/502] 10.222.0.41 () {64 vars in 1317 bytes} [Thu May 26 12:50:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:50:34.952495 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-dfa9b3a4-8301-471e-9959-f0ed6ad101a7 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:34.953092 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-c83376c8-a6da-4a8d-8775-ee2df24151ed tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:34.953211 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-dfa9b3a4-8301-471e-9959-f0ed6ad101a7 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: 1b2f404c-1ca9-4904-944c-16685c8f68c5] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:34.953321 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-c83376c8-a6da-4a8d-8775-ee2df24151ed tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: 7aa85144-0ebe-430c-b9e5-9b656ea4560a] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:34.959377 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-dfa9b3a4-8301-471e-9959-f0ed6ad101a7 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:34.959827 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-dfa9b3a4-8301-471e-9959-f0ed6ad101a7 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:34.961124 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-dfa9b3a4-8301-471e-9959-f0ed6ad101a7 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:34.961557 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-dfa9b3a4-8301-471e-9959-f0ed6ad101a7 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:34.964606 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-c83376c8-a6da-4a8d-8775-ee2df24151ed tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:34.965126 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-c83376c8-a6da-4a8d-8775-ee2df24151ed tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:34.965936 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-c83376c8-a6da-4a8d-8775-ee2df24151ed tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:34.966376 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-c83376c8-a6da-4a8d-8775-ee2df24151ed tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:35.139652 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-dfa9b3a4-8301-471e-9959-f0ed6ad101a7 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0537911b91184fcdbdcc9e93ec3fe5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad768b45d17480d8d6bbbcff6032c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:35.146366 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-c83376c8-a6da-4a8d-8775-ee2df24151ed tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:35.149233 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-dfa9b3a4-8301-471e-9959-f0ed6ad101a7 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "GET /compute/v2.1/servers/1b2f404c-1ca9-4904-944c-16685c8f68c5" status: 200 len: 1366 microversion: 2.1 time: 0.200680 May 26 12:50:35.149986 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 249/503] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:50:34 2022] GET /compute/v2.1/servers/1b2f404c-1ca9-4904-944c-16685c8f68c5 => generated 1366 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:35.155863 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-c83376c8-a6da-4a8d-8775-ee2df24151ed tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a" status: 200 len: 1734 microversion: 2.1 time: 0.207323 May 26 12:50:35.156452 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 255/504] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:50:34 2022] GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a => generated 1734 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:35.534700 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-d78a8998-e9e2-4cbf-9fa2-7e8b10ccb6b2 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:35.535514 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-d78a8998-e9e2-4cbf-9fa2-7e8b10ccb6b2 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 7ffbf048-2aa0-4656-a6cd-923b35031eaa] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:35.543237 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-d78a8998-e9e2-4cbf-9fa2-7e8b10ccb6b2 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:35.543695 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-d78a8998-e9e2-4cbf-9fa2-7e8b10ccb6b2 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:35.544473 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-d78a8998-e9e2-4cbf-9fa2-7e8b10ccb6b2 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:35.544915 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-d78a8998-e9e2-4cbf-9fa2-7e8b10ccb6b2 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:35.610880 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-d78a8998-e9e2-4cbf-9fa2-7e8b10ccb6b2 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:35.619312 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-d78a8998-e9e2-4cbf-9fa2-7e8b10ccb6b2 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:35.620855 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-d78a8998-e9e2-4cbf-9fa2-7e8b10ccb6b2 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:35.622252 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-d78a8998-e9e2-4cbf-9fa2-7e8b10ccb6b2 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa" status: 200 len: 1656 microversion: 2.20 time: 0.091892 May 26 12:50:35.623009 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 250/505] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:50:35 2022] GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa => generated 1656 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:50:36.169054 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-427b88d9-2972-4d01-963f-91088bbb0218 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:36.170294 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-427b88d9-2972-4d01-963f-91088bbb0218 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: 1b2f404c-1ca9-4904-944c-16685c8f68c5] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:36.176216 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-26212661-ea07-4ee9-b139-e6cac97c78cf tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:36.177340 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-26212661-ea07-4ee9-b139-e6cac97c78cf tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: 7aa85144-0ebe-430c-b9e5-9b656ea4560a] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:36.184127 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-427b88d9-2972-4d01-963f-91088bbb0218 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:36.185221 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-427b88d9-2972-4d01-963f-91088bbb0218 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:36.185684 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-26212661-ea07-4ee9-b139-e6cac97c78cf tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:36.186202 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-26212661-ea07-4ee9-b139-e6cac97c78cf tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:36.187094 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-26212661-ea07-4ee9-b139-e6cac97c78cf tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:36.187594 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-26212661-ea07-4ee9-b139-e6cac97c78cf tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:36.187898 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-427b88d9-2972-4d01-963f-91088bbb0218 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:36.189085 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-427b88d9-2972-4d01-963f-91088bbb0218 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:36.361694 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-427b88d9-2972-4d01-963f-91088bbb0218 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0537911b91184fcdbdcc9e93ec3fe5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad768b45d17480d8d6bbbcff6032c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:36.364245 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-26212661-ea07-4ee9-b139-e6cac97c78cf tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:36.370763 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-427b88d9-2972-4d01-963f-91088bbb0218 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "GET /compute/v2.1/servers/1b2f404c-1ca9-4904-944c-16685c8f68c5" status: 200 len: 1366 microversion: 2.1 time: 0.205544 May 26 12:50:36.371342 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 256/506] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:50:36 2022] GET /compute/v2.1/servers/1b2f404c-1ca9-4904-944c-16685c8f68c5 => generated 1366 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:36.372546 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-26212661-ea07-4ee9-b139-e6cac97c78cf tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a" status: 200 len: 1714 microversion: 2.1 time: 0.203022 May 26 12:50:36.373111 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 251/507] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:50:36 2022] GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a => generated 1714 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:50:36.480247 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-aa737209-a92f-4efc-b068-7598f4d07484 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:36.480504 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-aa737209-a92f-4efc-b068-7598f4d07484 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: 7aa85144-0ebe-430c-b9e5-9b656ea4560a] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:36.486667 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-aa737209-a92f-4efc-b068-7598f4d07484 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:36.487027 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-aa737209-a92f-4efc-b068-7598f4d07484 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:36.487858 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-aa737209-a92f-4efc-b068-7598f4d07484 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:36.488293 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-aa737209-a92f-4efc-b068-7598f4d07484 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:36.571188 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.wsgi [None req-aa737209-a92f-4efc-b068-7598f4d07484 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] HTTP exception thrown: Cannot 'detach_volume' instance 7aa85144-0ebe-430c-b9e5-9b656ea4560a while it is in vm_state rescued May 26 12:50:36.574331 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-aa737209-a92f-4efc-b068-7598f4d07484 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Request method failure captured: May 26 12:50:36.574331 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: request: DELETE /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a/os-volume_attachments/bf9d0267-8ae1-4469-b8b5-3c906ecd3af1 HTTP/1.1 May 26 12:50:36.574331 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Accept: application/json May 26 12:50:36.574331 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Accept-Encoding: identity May 26 12:50:36.574331 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Connection: close May 26 12:50:36.574331 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Content-Length: 0 May 26 12:50:36.574331 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Content-Type: application/json May 26 12:50:36.574331 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Host: 10.222.0.41 May 26 12:50:36.574331 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Openstack-System-Scope: None May 26 12:50:36.574331 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: User-Agent: python-urllib3/1.26.9 May 26 12:50:36.574331 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Auth-Token: gAAAAABij3aX6bwsviEkeUYewj-xlndiK1bsPBf92DMS42pl4gfoAWpT2Nwqjxg-XMZou9-CFzmPCmtZ9TjM3zfCdG4bAle_MvCdrJrquNKcFpkWDFLqcD6Kq3oa26r5AlaY0DKFiwUUVBB5lqaRpwXOXIz3ew4L1IUMZ8-eR1xMR1hG_1d6fpk May 26 12:50:36.574331 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Domain-Id: None May 26 12:50:36.574331 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Domain-Name: None May 26 12:50:36.574331 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Identity-Status: Confirmed May 26 12:50:36.574331 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Is-Admin-Project: True May 26 12:50:36.574331 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Project-Domain-Id: default May 26 12:50:36.574331 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Project-Domain-Name: Default May 26 12:50:36.574331 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Project-Id: 9930a0f4448d4ef0a6030da17a36257a May 26 12:50:36.574331 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1873359870 May 26 12:50:36.574331 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Role: member,reader May 26 12:50:36.574331 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Roles: member,reader May 26 12:50:36.575814 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/9930a0f4448d4ef0a6030da17a36257a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/9930a0f4448d4ef0a6030da17a36257a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/9930a0f4448d4ef0a6030da17a36257a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_9930a0f4448d4ef0a6030da17a36257a", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 26 12:50:36.575814 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1873359870 May 26 12:50:36.575814 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Tenant-Id: 9930a0f4448d4ef0a6030da17a36257a May 26 12:50:36.575814 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1873359870 May 26 12:50:36.575814 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User: tempest-ServerRescueNegativeTestJSON-1873359870-project May 26 12:50:36.575814 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User-Domain-Id: default May 26 12:50:36.575814 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User-Domain-Name: Default May 26 12:50:36.575814 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User-Id: cf98a4d33cab49b08640f437dbfb2dc8 May 26 12:50:36.575814 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1873359870-project May 26 12:50:36.575814 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: method: > May 26 12:50:36.575814 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: exception: Cannot 'detach_volume' instance 7aa85144-0ebe-430c-b9e5-9b656ea4560a while it is in vm_state rescued May 26 12:50:36.576494 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: action_args: {'server_id': '7aa85144-0ebe-430c-b9e5-9b656ea4560a', 'id': 'bf9d0267-8ae1-4469-b8b5-3c906ecd3af1'} May 26 12:50:36.576494 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:50:36.576494 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:50:36.576494 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 26 12:50:36.576494 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 26 12:50:36.576494 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 26 12:50:36.576494 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 12:50:36.576494 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 26 12:50:36.576494 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 26 12:50:36.576494 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7aa85144-0ebe-430c-b9e5-9b656ea4560a in vm_state rescued. Cannot detach_volume while the instance is in this state. May 26 12:50:36.576494 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:50:36.576494 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:50:36.576494 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:50:36.576494 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:50:36.576494 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:50:36.576494 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:50:36.576494 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:50:36.576494 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:50:36.576494 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:50:36.576494 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:50:36.577734 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 26 12:50:36.577734 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 26 12:50:36.577734 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 26 12:50:36.577734 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 26 12:50:36.577734 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 7aa85144-0ebe-430c-b9e5-9b656ea4560a while it is in vm_state rescued May 26 12:50:36.577734 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:50:36.577734 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:50:36.577734 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:50:36.577734 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:50:36.577734 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:50:36.577734 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:50:36.577734 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:50:36.577734 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:50:36.577734 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 7aa85144-0ebe-430c-b9e5-9b656ea4560a while it is in vm_state rescued May 26 12:50:36.577734 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:50:36.577734 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-aa737209-a92f-4efc-b068-7598f4d07484 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Returning 409 to user: Cannot 'detach_volume' instance 7aa85144-0ebe-430c-b9e5-9b656ea4560a while it is in vm_state rescued {{(pid=124823) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:50:36.578994 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-aa737209-a92f-4efc-b068-7598f4d07484 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "DELETE /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a/os-volume_attachments/bf9d0267-8ae1-4469-b8b5-3c906ecd3af1" status: 409 len: 152 microversion: 2.1 time: 0.098245 May 26 12:50:36.578994 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 257/508] 10.222.0.41 () {58 vars in 1415 bytes} [Thu May 26 12:50:36 2022] DELETE /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a/os-volume_attachments/bf9d0267-8ae1-4469-b8b5-3c906ecd3af1 => generated 152 bytes in 99 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 26 12:50:36.583264 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-159a0475-0012-46c4-89f9-5e189f938d37 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:50:36.583797 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-159a0475-0012-46c4-89f9-5e189f938d37 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: 7aa85144-0ebe-430c-b9e5-9b656ea4560a] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:36.589847 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-159a0475-0012-46c4-89f9-5e189f938d37 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:36.590296 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-159a0475-0012-46c4-89f9-5e189f938d37 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:36.591049 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-159a0475-0012-46c4-89f9-5e189f938d37 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:36.591490 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-159a0475-0012-46c4-89f9-5e189f938d37 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:36.640628 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-878eff3a-e3eb-4b3f-907f-d4908556e99c tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:36.641238 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-878eff3a-e3eb-4b3f-907f-d4908556e99c tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 7ffbf048-2aa0-4656-a6cd-923b35031eaa] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:36.648588 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-878eff3a-e3eb-4b3f-907f-d4908556e99c tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:36.649159 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-878eff3a-e3eb-4b3f-907f-d4908556e99c tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:36.649939 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-878eff3a-e3eb-4b3f-907f-d4908556e99c tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:36.650370 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-878eff3a-e3eb-4b3f-907f-d4908556e99c tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:36.683723 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-878eff3a-e3eb-4b3f-907f-d4908556e99c tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:36.684294 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-878eff3a-e3eb-4b3f-907f-d4908556e99c tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:36.684864 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.objects.instance [None req-878eff3a-e3eb-4b3f-907f-d4908556e99c tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lazy-loading 'fault' on Instance uuid 7ffbf048-2aa0-4656-a6cd-923b35031eaa {{(pid=124823) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:50:36.736402 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-878eff3a-e3eb-4b3f-907f-d4908556e99c tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:36.745115 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-878eff3a-e3eb-4b3f-907f-d4908556e99c tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:36.747018 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-878eff3a-e3eb-4b3f-907f-d4908556e99c tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:36.747967 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-878eff3a-e3eb-4b3f-907f-d4908556e99c tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa" status: 200 len: 1370 microversion: 2.20 time: 0.111520 May 26 12:50:36.748512 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 258/509] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:50:36 2022] GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa => generated 1370 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:50:36.814957 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-159a0475-0012-46c4-89f9-5e189f938d37 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "POST /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a/action" status: 202 len: 0 microversion: 2.1 time: 0.235355 May 26 12:50:36.815813 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 252/510] 10.222.0.41 () {60 vars in 1277 bytes} [Thu May 26 12:50:36 2022] POST /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a/action => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 26 12:50:36.825083 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-7abcfbef-a6d7-45d1-965f-616806a38774 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:36.825844 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-7abcfbef-a6d7-45d1-965f-616806a38774 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: 7aa85144-0ebe-430c-b9e5-9b656ea4560a] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:36.833147 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-7abcfbef-a6d7-45d1-965f-616806a38774 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:36.834858 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-7abcfbef-a6d7-45d1-965f-616806a38774 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:36.838140 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-7abcfbef-a6d7-45d1-965f-616806a38774 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:36.838140 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-7abcfbef-a6d7-45d1-965f-616806a38774 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:36.984529 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-7abcfbef-a6d7-45d1-965f-616806a38774 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:36.993443 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-7abcfbef-a6d7-45d1-965f-616806a38774 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a" status: 200 len: 1722 microversion: 2.1 time: 0.172607 May 26 12:50:36.994058 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 259/511] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:50:36 2022] GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:50:37.333096 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-7d713c19-32fc-4adc-a0a6-f1bae8d53e89 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:37.333690 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-7d713c19-32fc-4adc-a0a6-f1bae8d53e89 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] [instance: 4d941693-7aca-4eb9-b1eb-5add0d24b5c1] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:37.343444 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-7d713c19-32fc-4adc-a0a6-f1bae8d53e89 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:37.343444 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-7d713c19-32fc-4adc-a0a6-f1bae8d53e89 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:37.343444 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-7d713c19-32fc-4adc-a0a6-f1bae8d53e89 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:37.343444 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-7d713c19-32fc-4adc-a0a6-f1bae8d53e89 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:37.388332 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-e6f21589-0315-4b7d-ad19-a423f6c5654c tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:37.393064 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-e6f21589-0315-4b7d-ad19-a423f6c5654c tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: 1b2f404c-1ca9-4904-944c-16685c8f68c5] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:37.397102 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-e6f21589-0315-4b7d-ad19-a423f6c5654c tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:37.398298 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-e6f21589-0315-4b7d-ad19-a423f6c5654c tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:37.399252 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-e6f21589-0315-4b7d-ad19-a423f6c5654c tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:37.399686 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-e6f21589-0315-4b7d-ad19-a423f6c5654c tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:37.439583 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.objects.instance [None req-7d713c19-32fc-4adc-a0a6-f1bae8d53e89 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lazy-loading 'services' on Instance uuid 4d941693-7aca-4eb9-b1eb-5add0d24b5c1 {{(pid=124824) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:50:37.551388 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-e6f21589-0315-4b7d-ad19-a423f6c5654c tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0537911b91184fcdbdcc9e93ec3fe5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad768b45d17480d8d6bbbcff6032c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:37.558933 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-e6f21589-0315-4b7d-ad19-a423f6c5654c tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "GET /compute/v2.1/servers/1b2f404c-1ca9-4904-944c-16685c8f68c5" status: 200 len: 1366 microversion: 2.1 time: 0.174789 May 26 12:50:37.559504 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 260/512] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:50:37 2022] GET /compute/v2.1/servers/1b2f404c-1ca9-4904-944c-16685c8f68c5 => generated 1366 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:50:37.715460 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-7d713c19-32fc-4adc-a0a6-f1bae8d53e89 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] 10.222.0.41 "DELETE /compute/v2.1/servers/4d941693-7aca-4eb9-b1eb-5add0d24b5c1/os-volume_attachments/93b4d6bf-5c32-4e4e-bb86-cd2944cd445f" status: 202 len: 0 microversion: 2.1 time: 0.386948 May 26 12:50:37.716043 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 253/513] 10.222.0.41 () {58 vars in 1415 bytes} [Thu May 26 12:50:37 2022] DELETE /compute/v2.1/servers/4d941693-7aca-4eb9-b1eb-5add0d24b5c1/os-volume_attachments/93b4d6bf-5c32-4e4e-bb86-cd2944cd445f => generated 0 bytes in 389 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 12:50:37.765909 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-73eb1aa5-43f9-4949-b780-ad3d9d0f2eec tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:37.766610 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-73eb1aa5-43f9-4949-b780-ad3d9d0f2eec tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 7ffbf048-2aa0-4656-a6cd-923b35031eaa] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:37.773640 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-73eb1aa5-43f9-4949-b780-ad3d9d0f2eec tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:37.777271 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-73eb1aa5-43f9-4949-b780-ad3d9d0f2eec tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:37.777271 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-73eb1aa5-43f9-4949-b780-ad3d9d0f2eec tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:37.777271 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-73eb1aa5-43f9-4949-b780-ad3d9d0f2eec tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:37.788854 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.wsgi [None req-73eb1aa5-43f9-4949-b780-ad3d9d0f2eec tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] HTTP exception thrown: Instance 7ffbf048-2aa0-4656-a6cd-923b35031eaa could not be found. May 26 12:50:37.790569 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-73eb1aa5-43f9-4949-b780-ad3d9d0f2eec tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Request method failure captured: May 26 12:50:37.790569 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: request: GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa HTTP/1.1 May 26 12:50:37.790569 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Accept: application/json May 26 12:50:37.790569 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Accept-Encoding: identity May 26 12:50:37.790569 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Connection: close May 26 12:50:37.790569 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Content-Length: 0 May 26 12:50:37.790569 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Content-Type: application/json May 26 12:50:37.790569 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Host: 10.222.0.41 May 26 12:50:37.790569 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Openstack-System-Scope: None May 26 12:50:37.790569 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: User-Agent: python-urllib3/1.26.9 May 26 12:50:37.790569 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Auth-Token: gAAAAABij3abBk4ixrYEcFZRskYSxhBr1BCkYClQrGuO_Zlfka9R9-e6ixZLTtGe1W200ciU4afgT-iKNG2YLJ1qONbypQIEnsgLaiYYPe6pwbyXejvkUDELr69D4q55WjpJbcWJ9gyFD_X0vSqw695wlbN0CreDwdaxxmAax9eJyLpupDKc0iE May 26 12:50:37.790569 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Domain-Id: None May 26 12:50:37.790569 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Domain-Name: None May 26 12:50:37.790569 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Identity-Status: Confirmed May 26 12:50:37.790569 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Is-Admin-Project: True May 26 12:50:37.790569 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Openstack-Nova-Api-Version: 2.20 May 26 12:50:37.790569 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Project-Domain-Id: default May 26 12:50:37.790569 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Project-Domain-Name: Default May 26 12:50:37.790569 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Project-Id: a90e7edce8984d49b7bdebed2947b436 May 26 12:50:37.790569 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1557983772 May 26 12:50:37.790569 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Role: member,reader May 26 12:50:37.790569 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Roles: member,reader May 26 12:50:37.792157 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/a90e7edce8984d49b7bdebed2947b436"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/a90e7edce8984d49b7bdebed2947b436"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/a90e7edce8984d49b7bdebed2947b436"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_a90e7edce8984d49b7bdebed2947b436", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 26 12:50:37.792157 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1557983772 May 26 12:50:37.792157 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Tenant-Id: a90e7edce8984d49b7bdebed2947b436 May 26 12:50:37.792157 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1557983772 May 26 12:50:37.792157 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User: tempest-AttachVolumeShelveTestJSON-1557983772-project May 26 12:50:37.792157 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User-Domain-Id: default May 26 12:50:37.792157 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User-Domain-Name: Default May 26 12:50:37.792157 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User-Id: 1e83db01f0b24204a61b037b3c1f044c May 26 12:50:37.792157 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1557983772-project May 26 12:50:37.792157 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: method: > May 26 12:50:37.792157 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: exception: Instance 7ffbf048-2aa0-4656-a6cd-923b35031eaa could not be found. May 26 12:50:37.792157 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: action_args: {'id': '7ffbf048-2aa0-4656-a6cd-923b35031eaa'} May 26 12:50:37.793138 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:50:37.793138 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:50:37.793138 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:50:37.793138 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:50:37.793138 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:50:37.793138 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:50:37.793138 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:50:37.793138 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:50:37.793138 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:50:37.793138 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:50:37.793138 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ffbf048-2aa0-4656-a6cd-923b35031eaa could not be found. May 26 12:50:37.793138 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:50:37.793138 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:50:37.793138 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:50:37.793138 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:50:37.793138 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:50:37.793138 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:50:37.793138 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:50:37.793138 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:50:37.793138 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:50:37.795252 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:50:37.795252 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 12:50:37.795252 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 12:50:37.795252 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:50:37.795252 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:50:37.795252 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:50:37.795252 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:50:37.795252 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ffbf048-2aa0-4656-a6cd-923b35031eaa could not be found. May 26 12:50:37.795252 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:50:37.795252 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:50:37.795252 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:50:37.795252 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:50:37.795252 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:50:37.795252 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:50:37.795252 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:50:37.795252 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:50:37.795252 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ffbf048-2aa0-4656-a6cd-923b35031eaa could not be found. May 26 12:50:37.795252 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:50:37.796966 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-73eb1aa5-43f9-4949-b780-ad3d9d0f2eec tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Returning 404 to user: Instance 7ffbf048-2aa0-4656-a6cd-923b35031eaa could not be found. {{(pid=124823) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:50:37.796966 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-73eb1aa5-43f9-4949-b780-ad3d9d0f2eec tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa" status: 404 len: 111 microversion: 2.20 time: 0.030244 May 26 12:50:37.796966 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 261/514] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:50:37 2022] GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 26 12:50:37.801500 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-bf1dcdd8-e4f6-43ee-bd52-016bbb834290 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '.version_select at 0x7f26a1e41af0>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:37.875415 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-bf1dcdd8-e4f6-43ee-bd52-016bbb834290 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-186672759" status: 204 len: 0 microversion: 2.20 time: 0.077829 May 26 12:50:37.875910 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 254/515] 10.222.0.41 () {60 vars in 1258 bytes} [Thu May 26 12:50:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-186672759 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 26 12:50:38.011984 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-c5c1173d-4f48-49ae-837b-c8f73823c156 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:38.012588 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-c5c1173d-4f48-49ae-837b-c8f73823c156 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: 7aa85144-0ebe-430c-b9e5-9b656ea4560a] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:38.018853 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-c5c1173d-4f48-49ae-837b-c8f73823c156 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:38.019296 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-c5c1173d-4f48-49ae-837b-c8f73823c156 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:38.020049 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-c5c1173d-4f48-49ae-837b-c8f73823c156 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:38.020476 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-c5c1173d-4f48-49ae-837b-c8f73823c156 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:38.171235 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-c5c1173d-4f48-49ae-837b-c8f73823c156 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:38.180379 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-c5c1173d-4f48-49ae-837b-c8f73823c156 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a" status: 200 len: 1722 microversion: 2.1 time: 0.173108 May 26 12:50:38.189944 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 262/516] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:50:38 2022] GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a => generated 1722 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:38.576131 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-6ee4c1b9-9751-4a1a-b213-fcc03eeb3127 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:38.576867 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-6ee4c1b9-9751-4a1a-b213-fcc03eeb3127 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: 1b2f404c-1ca9-4904-944c-16685c8f68c5] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:38.583275 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-6ee4c1b9-9751-4a1a-b213-fcc03eeb3127 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:38.583717 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-6ee4c1b9-9751-4a1a-b213-fcc03eeb3127 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:38.584498 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-6ee4c1b9-9751-4a1a-b213-fcc03eeb3127 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:38.584927 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-6ee4c1b9-9751-4a1a-b213-fcc03eeb3127 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:38.799645 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-6ee4c1b9-9751-4a1a-b213-fcc03eeb3127 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0537911b91184fcdbdcc9e93ec3fe5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad768b45d17480d8d6bbbcff6032c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:38.808021 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-6ee4c1b9-9751-4a1a-b213-fcc03eeb3127 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "GET /compute/v2.1/servers/1b2f404c-1ca9-4904-944c-16685c8f68c5" status: 200 len: 1366 microversion: 2.1 time: 0.236158 May 26 12:50:38.808709 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 255/517] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:50:38 2022] GET /compute/v2.1/servers/1b2f404c-1ca9-4904-944c-16685c8f68c5 => generated 1366 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:38.833963 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-6e34b8b1-d87b-42cd-84e6-cbd7ece9b560 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Action: 'create', calling method: .version_select at 0x7f26a1f7aaf0>, body: {"keypair": {"name": "tempest-keypair-2064790035", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK3itvDj4C2Uy2KNCWbYnO0Km4s7cGRncHxW/jPTmQb8C2x3wRu1J5WXbNNMp9LTu2K8sUUVn1r7s6xKE09Opr1zY/xLvnEzfX3ss5E24VpH93Ms/V5x+SG3tMY5br+ZFw=="}} {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:50:38.848443 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.quota [None req-6e34b8b1-d87b-42cd-84e6-cbd7ece9b560 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Getting quotas for project a90e7edce8984d49b7bdebed2947b436. Resources: {'key_pairs'} {{(pid=124823) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:50:38.852266 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.quota [None req-6e34b8b1-d87b-42cd-84e6-cbd7ece9b560 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Getting quotas for user 1e83db01f0b24204a61b037b3c1f044c and project a90e7edce8984d49b7bdebed2947b436. Resources: {'key_pairs'} {{(pid=124823) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:50:38.957309 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-6e34b8b1-d87b-42cd-84e6-cbd7ece9b560 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.127090 May 26 12:50:38.957865 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 263/518] 10.222.0.41 () {62 vars in 1199 bytes} [Thu May 26 12:50:38 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 128 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) May 26 12:50:39.197587 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-0bda1de0-a5ab-4435-8d44-bce02daa0fce tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:39.198226 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-0bda1de0-a5ab-4435-8d44-bce02daa0fce tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: 7aa85144-0ebe-430c-b9e5-9b656ea4560a] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:39.204391 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-0bda1de0-a5ab-4435-8d44-bce02daa0fce tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:39.204849 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-0bda1de0-a5ab-4435-8d44-bce02daa0fce tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:39.205617 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-0bda1de0-a5ab-4435-8d44-bce02daa0fce tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:39.206057 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-0bda1de0-a5ab-4435-8d44-bce02daa0fce tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:39.365189 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-0bda1de0-a5ab-4435-8d44-bce02daa0fce tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:39.373800 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-0bda1de0-a5ab-4435-8d44-bce02daa0fce tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a" status: 200 len: 1722 microversion: 2.1 time: 0.180032 May 26 12:50:39.377809 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 256/519] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:50:39 2022] GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a => generated 1722 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:39.826168 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-d93975e7-52b3-4a97-8493-e84c03036fef tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:39.826701 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-d93975e7-52b3-4a97-8493-e84c03036fef tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: 1b2f404c-1ca9-4904-944c-16685c8f68c5] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:39.832862 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-d93975e7-52b3-4a97-8493-e84c03036fef tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:39.833318 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-d93975e7-52b3-4a97-8493-e84c03036fef tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:39.834144 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-d93975e7-52b3-4a97-8493-e84c03036fef tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:39.834684 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-d93975e7-52b3-4a97-8493-e84c03036fef tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:40.005740 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-d93975e7-52b3-4a97-8493-e84c03036fef tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0537911b91184fcdbdcc9e93ec3fe5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad768b45d17480d8d6bbbcff6032c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:40.013996 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-d93975e7-52b3-4a97-8493-e84c03036fef tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "GET /compute/v2.1/servers/1b2f404c-1ca9-4904-944c-16685c8f68c5" status: 200 len: 1366 microversion: 2.1 time: 0.191874 May 26 12:50:40.014576 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 264/520] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:50:39 2022] GET /compute/v2.1/servers/1b2f404c-1ca9-4904-944c-16685c8f68c5 => generated 1366 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:40.390736 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-7f56390b-55f2-4ff1-82e0-4e802bf4d001 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:40.391353 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-7f56390b-55f2-4ff1-82e0-4e802bf4d001 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: 7aa85144-0ebe-430c-b9e5-9b656ea4560a] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:40.398934 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-7f56390b-55f2-4ff1-82e0-4e802bf4d001 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:40.399388 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-7f56390b-55f2-4ff1-82e0-4e802bf4d001 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:40.400167 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-7f56390b-55f2-4ff1-82e0-4e802bf4d001 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:40.400601 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-7f56390b-55f2-4ff1-82e0-4e802bf4d001 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:40.538044 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-7f56390b-55f2-4ff1-82e0-4e802bf4d001 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:40.546814 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-7f56390b-55f2-4ff1-82e0-4e802bf4d001 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a" status: 200 len: 1722 microversion: 2.1 time: 0.159917 May 26 12:50:40.547373 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 257/521] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:50:40 2022] GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:41.031415 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-15f3beef-74aa-40e6-84c2-e57e47f71d0e tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:41.032038 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-15f3beef-74aa-40e6-84c2-e57e47f71d0e tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: 1b2f404c-1ca9-4904-944c-16685c8f68c5] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:41.039704 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-15f3beef-74aa-40e6-84c2-e57e47f71d0e tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:41.040150 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-15f3beef-74aa-40e6-84c2-e57e47f71d0e tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:41.040913 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-15f3beef-74aa-40e6-84c2-e57e47f71d0e tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:41.041343 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-15f3beef-74aa-40e6-84c2-e57e47f71d0e tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:41.215973 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-15f3beef-74aa-40e6-84c2-e57e47f71d0e tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0537911b91184fcdbdcc9e93ec3fe5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad768b45d17480d8d6bbbcff6032c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:41.223962 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-15f3beef-74aa-40e6-84c2-e57e47f71d0e tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "GET /compute/v2.1/servers/1b2f404c-1ca9-4904-944c-16685c8f68c5" status: 200 len: 1366 microversion: 2.1 time: 0.196453 May 26 12:50:41.231283 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 265/522] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:50:41 2022] GET /compute/v2.1/servers/1b2f404c-1ca9-4904-944c-16685c8f68c5 => generated 1366 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:41.564058 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-32d29251-f705-44ef-bdad-dd6b157856f3 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:41.564740 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-32d29251-f705-44ef-bdad-dd6b157856f3 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: 7aa85144-0ebe-430c-b9e5-9b656ea4560a] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:41.572152 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-32d29251-f705-44ef-bdad-dd6b157856f3 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:41.572600 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-32d29251-f705-44ef-bdad-dd6b157856f3 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:41.573376 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-32d29251-f705-44ef-bdad-dd6b157856f3 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:41.573851 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-32d29251-f705-44ef-bdad-dd6b157856f3 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:41.575918 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-60b38924-feec-4a14-b1f0-501730e2f71e tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1129787053", "imageRef": "6df25342-b071-489b-a7c1-3089fa19af6d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5ba883d8-de3a-4796-ad52-4228606fa333"}], "security_groups": [{"name": "tempest-securitygroup--257806518"}], "key_name": "tempest-keypair-2064790035", "user_data": "}} {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:50:41.682172 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.network.neutron [None req-60b38924-feec-4a14-b1f0-501730e2f71e tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] validate_networks() for [('5ba883d8-de3a-4796-ad52-4228606fa333', None, None, None, None, None)] {{(pid=124823) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 12:50:41.707447 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-32d29251-f705-44ef-bdad-dd6b157856f3 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:41.715882 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-32d29251-f705-44ef-bdad-dd6b157856f3 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a" status: 200 len: 1722 microversion: 2.1 time: 0.155781 May 26 12:50:41.716505 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 258/523] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:50:41 2022] GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:42.044772 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.virt.hardware [None req-60b38924-feec-4a14-b1f0-501730e2f71e tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Flavor limits 0:0:0 {{(pid=124823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 12:50:42.045253 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.virt.hardware [None req-60b38924-feec-4a14-b1f0-501730e2f71e tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Image limits 0:0:0 {{(pid=124823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 12:50:42.045648 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.virt.hardware [None req-60b38924-feec-4a14-b1f0-501730e2f71e tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Flavor pref 0:0:0 {{(pid=124823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 12:50:42.046088 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.virt.hardware [None req-60b38924-feec-4a14-b1f0-501730e2f71e tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Image pref 0:0:0 {{(pid=124823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 12:50:42.046495 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.virt.hardware [None req-60b38924-feec-4a14-b1f0-501730e2f71e tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 12:50:42.056105 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-60b38924-feec-4a14-b1f0-501730e2f71e tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:42.056552 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-60b38924-feec-4a14-b1f0-501730e2f71e tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:42.059309 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-60b38924-feec-4a14-b1f0-501730e2f71e tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:42.059309 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-60b38924-feec-4a14-b1f0-501730e2f71e tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:42.076177 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.quota [None req-60b38924-feec-4a14-b1f0-501730e2f71e tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Getting quotas for project a90e7edce8984d49b7bdebed2947b436. Resources: {'instances', 'ram', 'cores'} {{(pid=124823) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:50:42.079632 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.quota [None req-60b38924-feec-4a14-b1f0-501730e2f71e tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Getting quotas for user 1e83db01f0b24204a61b037b3c1f044c and project a90e7edce8984d49b7bdebed2947b436. Resources: {'instances', 'ram', 'cores'} {{(pid=124823) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:50:42.092862 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-60b38924-feec-4a14-b1f0-501730e2f71e tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Going to run 1 instances... {{(pid=124823) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 12:50:42.095282 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-60b38924-feec-4a14-b1f0-501730e2f71e tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 73592c9c-6dae-4521-a03d-e02749530cac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6df25342-b071-489b-a7c1-3089fa19af6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124823) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 12:50:42.240793 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-9eb7639c-8ac6-40c8-807b-057b85c105e5 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:42.241318 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-9eb7639c-8ac6-40c8-807b-057b85c105e5 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: 1b2f404c-1ca9-4904-944c-16685c8f68c5] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:42.248100 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-9eb7639c-8ac6-40c8-807b-057b85c105e5 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:42.248553 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-9eb7639c-8ac6-40c8-807b-057b85c105e5 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:42.249332 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-9eb7639c-8ac6-40c8-807b-057b85c105e5 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:42.251247 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-9eb7639c-8ac6-40c8-807b-057b85c105e5 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:42.385322 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-9eb7639c-8ac6-40c8-807b-057b85c105e5 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0537911b91184fcdbdcc9e93ec3fe5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad768b45d17480d8d6bbbcff6032c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:42.392776 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-9eb7639c-8ac6-40c8-807b-057b85c105e5 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "GET /compute/v2.1/servers/1b2f404c-1ca9-4904-944c-16685c8f68c5" status: 200 len: 1366 microversion: 2.1 time: 0.156071 May 26 12:50:42.393341 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 259/524] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:50:42 2022] GET /compute/v2.1/servers/1b2f404c-1ca9-4904-944c-16685c8f68c5 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:50:42.421279 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-60b38924-feec-4a14-b1f0-501730e2f71e tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.849669 May 26 12:50:42.427024 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 266/525] 10.222.0.41 () {62 vars in 1187 bytes} [Thu May 26 12:50:41 2022] POST /compute/v2.1/servers => generated 401 bytes in 851 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 26 12:50:42.433066 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-15cf0177-f239-4ff3-a549-2efe4ed8fad1 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:42.433713 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-15cf0177-f239-4ff3-a549-2efe4ed8fad1 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 73592c9c-6dae-4521-a03d-e02749530cac] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:42.520312 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-15cf0177-f239-4ff3-a549-2efe4ed8fad1 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:42.520312 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-15cf0177-f239-4ff3-a549-2efe4ed8fad1 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:42.521343 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-15cf0177-f239-4ff3-a549-2efe4ed8fad1 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:42.521343 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-15cf0177-f239-4ff3-a549-2efe4ed8fad1 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac" status: 200 len: 1282 microversion: 2.20 time: 0.087623 May 26 12:50:42.521343 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 260/526] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:50:42 2022] GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac => generated 1282 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:50:42.733523 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-539574c7-3803-4434-83b7-d5094b1d1870 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:42.734159 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-539574c7-3803-4434-83b7-d5094b1d1870 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: 7aa85144-0ebe-430c-b9e5-9b656ea4560a] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:42.740329 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-539574c7-3803-4434-83b7-d5094b1d1870 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:42.740765 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-539574c7-3803-4434-83b7-d5094b1d1870 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:42.741705 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-539574c7-3803-4434-83b7-d5094b1d1870 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:42.742095 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-539574c7-3803-4434-83b7-d5094b1d1870 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:42.900453 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-539574c7-3803-4434-83b7-d5094b1d1870 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:42.905430 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-539574c7-3803-4434-83b7-d5094b1d1870 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a" status: 200 len: 1728 microversion: 2.1 time: 0.175423 May 26 12:50:42.905745 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 267/527] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:50:42 2022] GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a => generated 1728 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:42.921808 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-63deb82b-9e19-4869-b153-354933627401 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:42.922576 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-63deb82b-9e19-4869-b153-354933627401 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: 7aa85144-0ebe-430c-b9e5-9b656ea4560a] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:42.929344 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-63deb82b-9e19-4869-b153-354933627401 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:42.929821 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-63deb82b-9e19-4869-b153-354933627401 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:42.930588 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-63deb82b-9e19-4869-b153-354933627401 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:42.931015 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-63deb82b-9e19-4869-b153-354933627401 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:43.011559 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-63deb82b-9e19-4869-b153-354933627401 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093673 May 26 12:50:43.012149 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 261/528] 10.222.0.41 () {58 vars in 1274 bytes} [Thu May 26 12:50:42 2022] GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:50:43.057288 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-65207234-9709-486a-9cdf-7ceb709c5e99 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:43.057867 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-65207234-9709-486a-9cdf-7ceb709c5e99 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] [instance: 4d941693-7aca-4eb9-b1eb-5add0d24b5c1] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:43.061838 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG dbcounter [-] [124823] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=124823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:50:43.066292 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-65207234-9709-486a-9cdf-7ceb709c5e99 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:43.066737 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-65207234-9709-486a-9cdf-7ceb709c5e99 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:43.067669 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-65207234-9709-486a-9cdf-7ceb709c5e99 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:43.068099 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-65207234-9709-486a-9cdf-7ceb709c5e99 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:43.073246 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG dbcounter [-] [124823] Writing DB stats nova_cell1:SELECT=100 {{(pid=124823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:50:43.102920 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-65207234-9709-486a-9cdf-7ceb709c5e99 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] [instance: 4d941693-7aca-4eb9-b1eb-5add0d24b5c1] Going to try to terminate instance {{(pid=124823) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 12:50:43.408811 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-cf17f4e5-579e-4cb0-a193-532f1ebaebe4 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:43.409482 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-cf17f4e5-579e-4cb0-a193-532f1ebaebe4 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: 1b2f404c-1ca9-4904-944c-16685c8f68c5] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:43.431383 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-cf17f4e5-579e-4cb0-a193-532f1ebaebe4 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:43.431860 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-cf17f4e5-579e-4cb0-a193-532f1ebaebe4 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:43.432633 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-cf17f4e5-579e-4cb0-a193-532f1ebaebe4 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:43.433072 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-cf17f4e5-579e-4cb0-a193-532f1ebaebe4 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:43.437909 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG dbcounter [-] [124824] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=124824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:50:43.577238 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-65207234-9709-486a-9cdf-7ceb709c5e99 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] 10.222.0.41 "DELETE /compute/v2.1/servers/4d941693-7aca-4eb9-b1eb-5add0d24b5c1" status: 204 len: 0 microversion: 2.1 time: 0.522821 May 26 12:50:43.581309 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 268/529] 10.222.0.41 () {58 vars in 1238 bytes} [Thu May 26 12:50:43 2022] DELETE /compute/v2.1/servers/4d941693-7aca-4eb9-b1eb-5add0d24b5c1 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 12:50:43.584049 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-2c523946-d49b-421b-9943-3cce357cdea1 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:43.584741 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-2c523946-d49b-421b-9943-3cce357cdea1 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 73592c9c-6dae-4521-a03d-e02749530cac] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:43.589827 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-cf17f4e5-579e-4cb0-a193-532f1ebaebe4 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0537911b91184fcdbdcc9e93ec3fe5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad768b45d17480d8d6bbbcff6032c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:43.591121 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-2c523946-d49b-421b-9943-3cce357cdea1 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:43.591552 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-2c523946-d49b-421b-9943-3cce357cdea1 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:43.592316 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-2c523946-d49b-421b-9943-3cce357cdea1 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:43.592739 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-2c523946-d49b-421b-9943-3cce357cdea1 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:43.597689 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-cf17f4e5-579e-4cb0-a193-532f1ebaebe4 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "GET /compute/v2.1/servers/1b2f404c-1ca9-4904-944c-16685c8f68c5" status: 200 len: 1366 microversion: 2.1 time: 0.192890 May 26 12:50:43.598617 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 262/530] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:50:43 2022] GET /compute/v2.1/servers/1b2f404c-1ca9-4904-944c-16685c8f68c5 => generated 1366 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:43.603785 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [req-c899b923-5780-40f3-9460-8150d22faf58 req-4ab6b869-7784-4d2b-8364-ce70ff8630d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b2f404c-1ca9-4904-944c-16685c8f68c5", "name": "network-vif-plugged", "status": "completed", "tag": "a3a568a1-60df-415d-9fd4-02eab3f0bfce"}]} {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:50:43.612290 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [req-c899b923-5780-40f3-9460-8150d22faf58 req-4ab6b869-7784-4d2b-8364-ce70ff8630d7 service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:43.612818 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [req-c899b923-5780-40f3-9460-8150d22faf58 req-4ab6b869-7784-4d2b-8364-ce70ff8630d7 service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:43.624427 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.compute.server_external_events [req-c899b923-5780-40f3-9460-8150d22faf58 req-4ab6b869-7784-4d2b-8364-ce70ff8630d7 service nova] Creating event network-vif-plugged:a3a568a1-60df-415d-9fd4-02eab3f0bfce for instance 1b2f404c-1ca9-4904-944c-16685c8f68c5 on hv-cinder-81571 May 26 12:50:43.629802 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [req-c899b923-5780-40f3-9460-8150d22faf58 req-4ab6b869-7784-4d2b-8364-ce70ff8630d7 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029930 May 26 12:50:43.630429 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 263/531] 10.222.0.41 () {64 vars in 1317 bytes} [Thu May 26 12:50:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:50:43.635889 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-0f13cd6c-6c2b-4aea-bbc5-02bf7899ddc2 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:43.636593 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-0f13cd6c-6c2b-4aea-bbc5-02bf7899ddc2 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] [instance: 4d941693-7aca-4eb9-b1eb-5add0d24b5c1] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:43.643247 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-0f13cd6c-6c2b-4aea-bbc5-02bf7899ddc2 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:43.643747 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-0f13cd6c-6c2b-4aea-bbc5-02bf7899ddc2 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:43.644516 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-0f13cd6c-6c2b-4aea-bbc5-02bf7899ddc2 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:43.644938 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-0f13cd6c-6c2b-4aea-bbc5-02bf7899ddc2 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:43.659724 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-2c523946-d49b-421b-9943-3cce357cdea1 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:43.669310 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-2c523946-d49b-421b-9943-3cce357cdea1 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:43.671886 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-2c523946-d49b-421b-9943-3cce357cdea1 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:43.673311 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-2c523946-d49b-421b-9943-3cce357cdea1 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac" status: 200 len: 1286 microversion: 2.20 time: 0.093951 May 26 12:50:43.673911 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 269/532] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:50:43 2022] GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac => generated 1286 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:50:43.800433 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-0f13cd6c-6c2b-4aea-bbc5-02bf7899ddc2 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646a9abb1f9d4a1295a04defd895ff7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd539dfec943a44eb9b025d842a1f858d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:43.809265 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-0f13cd6c-6c2b-4aea-bbc5-02bf7899ddc2 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] 10.222.0.41 "GET /compute/v2.1/servers/4d941693-7aca-4eb9-b1eb-5add0d24b5c1" status: 200 len: 1514 microversion: 2.1 time: 0.177635 May 26 12:50:43.812604 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 264/533] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:50:43 2022] GET /compute/v2.1/servers/4d941693-7aca-4eb9-b1eb-5add0d24b5c1 => generated 1514 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:44.276127 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [req-816ce4ec-1147-4f3e-884d-4dd1dfe533d8 req-0b99e7c9-d0f5-4816-9e00-146039c90699 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7aa85144-0ebe-430c-b9e5-9b656ea4560a", "tag": "e5a6930c-e135-4546-bcdc-823bfe4c6e87"}]} {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:50:44.290638 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [req-816ce4ec-1147-4f3e-884d-4dd1dfe533d8 req-0b99e7c9-d0f5-4816-9e00-146039c90699 service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:44.291192 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [req-816ce4ec-1147-4f3e-884d-4dd1dfe533d8 req-0b99e7c9-d0f5-4816-9e00-146039c90699 service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:44.302945 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.compute.server_external_events [req-816ce4ec-1147-4f3e-884d-4dd1dfe533d8 req-0b99e7c9-d0f5-4816-9e00-146039c90699 service nova] Creating event network-changed:e5a6930c-e135-4546-bcdc-823bfe4c6e87 for instance 7aa85144-0ebe-430c-b9e5-9b656ea4560a on hv-cinder-81571 May 26 12:50:44.308096 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [req-816ce4ec-1147-4f3e-884d-4dd1dfe533d8 req-0b99e7c9-d0f5-4816-9e00-146039c90699 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036590 May 26 12:50:44.308708 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 270/534] 10.222.0.41 () {64 vars in 1317 bytes} [Thu May 26 12:50:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:50:44.615975 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-3a85999d-7621-4671-94bf-b7631f60963b tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:44.616848 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-3a85999d-7621-4671-94bf-b7631f60963b tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: 1b2f404c-1ca9-4904-944c-16685c8f68c5] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:44.623911 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-3a85999d-7621-4671-94bf-b7631f60963b tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:44.624439 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-3a85999d-7621-4671-94bf-b7631f60963b tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:44.625202 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-3a85999d-7621-4671-94bf-b7631f60963b tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:44.625630 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-3a85999d-7621-4671-94bf-b7631f60963b tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:44.694234 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-b5972b0b-092d-4ab3-837b-77d7b20cf703 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:44.696183 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-b5972b0b-092d-4ab3-837b-77d7b20cf703 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 73592c9c-6dae-4521-a03d-e02749530cac] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:44.703586 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-b5972b0b-092d-4ab3-837b-77d7b20cf703 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:44.704152 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-b5972b0b-092d-4ab3-837b-77d7b20cf703 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:44.705116 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-b5972b0b-092d-4ab3-837b-77d7b20cf703 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:44.705994 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-b5972b0b-092d-4ab3-837b-77d7b20cf703 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:44.760886 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-3a85999d-7621-4671-94bf-b7631f60963b tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0537911b91184fcdbdcc9e93ec3fe5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad768b45d17480d8d6bbbcff6032c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:44.769191 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-3a85999d-7621-4671-94bf-b7631f60963b tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "GET /compute/v2.1/servers/1b2f404c-1ca9-4904-944c-16685c8f68c5" status: 200 len: 1366 microversion: 2.1 time: 0.157463 May 26 12:50:44.769798 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 265/535] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:50:44 2022] GET /compute/v2.1/servers/1b2f404c-1ca9-4904-944c-16685c8f68c5 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:44.779753 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-b5972b0b-092d-4ab3-837b-77d7b20cf703 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:44.788039 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-b5972b0b-092d-4ab3-837b-77d7b20cf703 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:44.789799 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-b5972b0b-092d-4ab3-837b-77d7b20cf703 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:44.790944 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-b5972b0b-092d-4ab3-837b-77d7b20cf703 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac" status: 200 len: 1286 microversion: 2.20 time: 0.101527 May 26 12:50:44.791506 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 271/536] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:50:44 2022] GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac => generated 1286 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:50:44.827078 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-a2973114-bfa2-4cd8-bb97-bb8f598e5ae2 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:44.827699 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-a2973114-bfa2-4cd8-bb97-bb8f598e5ae2 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] [instance: 4d941693-7aca-4eb9-b1eb-5add0d24b5c1] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:44.833979 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-a2973114-bfa2-4cd8-bb97-bb8f598e5ae2 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:44.834517 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-a2973114-bfa2-4cd8-bb97-bb8f598e5ae2 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:44.835285 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-a2973114-bfa2-4cd8-bb97-bb8f598e5ae2 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:44.835718 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-a2973114-bfa2-4cd8-bb97-bb8f598e5ae2 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:44.972100 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-a2973114-bfa2-4cd8-bb97-bb8f598e5ae2 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646a9abb1f9d4a1295a04defd895ff7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd539dfec943a44eb9b025d842a1f858d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:44.980402 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-a2973114-bfa2-4cd8-bb97-bb8f598e5ae2 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] 10.222.0.41 "GET /compute/v2.1/servers/4d941693-7aca-4eb9-b1eb-5add0d24b5c1" status: 200 len: 1514 microversion: 2.1 time: 0.157174 May 26 12:50:44.983021 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 266/537] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:50:44 2022] GET /compute/v2.1/servers/4d941693-7aca-4eb9-b1eb-5add0d24b5c1 => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:45.787218 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-a311ed37-c306-47d7-b27c-cc73c5ddea31 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:45.787842 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-a311ed37-c306-47d7-b27c-cc73c5ddea31 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: 1b2f404c-1ca9-4904-944c-16685c8f68c5] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:45.795229 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-a311ed37-c306-47d7-b27c-cc73c5ddea31 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:45.795789 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-a311ed37-c306-47d7-b27c-cc73c5ddea31 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:45.796715 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-a311ed37-c306-47d7-b27c-cc73c5ddea31 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:45.797228 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-a311ed37-c306-47d7-b27c-cc73c5ddea31 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:45.809638 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-91c1df7a-9a34-45d4-922b-a2d63b7d9624 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:45.810609 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-91c1df7a-9a34-45d4-922b-a2d63b7d9624 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 73592c9c-6dae-4521-a03d-e02749530cac] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:45.835914 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-91c1df7a-9a34-45d4-922b-a2d63b7d9624 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:45.836371 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-91c1df7a-9a34-45d4-922b-a2d63b7d9624 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:45.837165 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-91c1df7a-9a34-45d4-922b-a2d63b7d9624 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:45.837602 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-91c1df7a-9a34-45d4-922b-a2d63b7d9624 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:45.953340 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-91c1df7a-9a34-45d4-922b-a2d63b7d9624 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:45.964935 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-91c1df7a-9a34-45d4-922b-a2d63b7d9624 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:45.966492 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-91c1df7a-9a34-45d4-922b-a2d63b7d9624 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:45.967610 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-91c1df7a-9a34-45d4-922b-a2d63b7d9624 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac" status: 200 len: 1334 microversion: 2.20 time: 0.163154 May 26 12:50:45.968360 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 267/538] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:50:45 2022] GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac => generated 1334 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:50:45.998501 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-61005fdf-3a51-49d1-8c3f-3dd0a17df817 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:45.999258 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-61005fdf-3a51-49d1-8c3f-3dd0a17df817 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] [instance: 4d941693-7aca-4eb9-b1eb-5add0d24b5c1] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:46.006178 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-61005fdf-3a51-49d1-8c3f-3dd0a17df817 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:46.006656 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-61005fdf-3a51-49d1-8c3f-3dd0a17df817 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:46.008023 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-61005fdf-3a51-49d1-8c3f-3dd0a17df817 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:46.008551 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-61005fdf-3a51-49d1-8c3f-3dd0a17df817 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:46.013897 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-a311ed37-c306-47d7-b27c-cc73c5ddea31 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0537911b91184fcdbdcc9e93ec3fe5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad768b45d17480d8d6bbbcff6032c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:46.021579 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-a311ed37-c306-47d7-b27c-cc73c5ddea31 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "GET /compute/v2.1/servers/1b2f404c-1ca9-4904-944c-16685c8f68c5" status: 200 len: 1366 microversion: 2.1 time: 0.238388 May 26 12:50:46.031793 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 272/539] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:50:45 2022] GET /compute/v2.1/servers/1b2f404c-1ca9-4904-944c-16685c8f68c5 => generated 1366 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:46.143201 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-61005fdf-3a51-49d1-8c3f-3dd0a17df817 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646a9abb1f9d4a1295a04defd895ff7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd539dfec943a44eb9b025d842a1f858d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:46.151310 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-61005fdf-3a51-49d1-8c3f-3dd0a17df817 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] 10.222.0.41 "GET /compute/v2.1/servers/4d941693-7aca-4eb9-b1eb-5add0d24b5c1" status: 200 len: 1514 microversion: 2.1 time: 0.157070 May 26 12:50:46.151872 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 268/540] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:50:45 2022] GET /compute/v2.1/servers/4d941693-7aca-4eb9-b1eb-5add0d24b5c1 => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:50:46.249911 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [req-1b8da930-14ef-4a66-9f21-3dca53f4363d req-d0bcd857-63a8-4bdd-90d1-54f8ae005e52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d941693-7aca-4eb9-b1eb-5add0d24b5c1", "name": "network-vif-deleted", "tag": "efe77520-8c46-4866-b802-5b04f9dea304"}]} {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:50:46.258778 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [req-1b8da930-14ef-4a66-9f21-3dca53f4363d req-d0bcd857-63a8-4bdd-90d1-54f8ae005e52 service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:46.259225 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [req-1b8da930-14ef-4a66-9f21-3dca53f4363d req-d0bcd857-63a8-4bdd-90d1-54f8ae005e52 service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:46.270144 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.compute.server_external_events [req-1b8da930-14ef-4a66-9f21-3dca53f4363d req-d0bcd857-63a8-4bdd-90d1-54f8ae005e52 service nova] Creating event network-vif-deleted:efe77520-8c46-4866-b802-5b04f9dea304 for instance 4d941693-7aca-4eb9-b1eb-5add0d24b5c1 on hv-cinder-81571 May 26 12:50:46.275195 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [req-1b8da930-14ef-4a66-9f21-3dca53f4363d req-d0bcd857-63a8-4bdd-90d1-54f8ae005e52 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029385 May 26 12:50:46.275842 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 273/541] 10.222.0.41 () {64 vars in 1317 bytes} [Thu May 26 12:50:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:50:46.323352 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [req-36b12600-2a1f-4bed-806d-8c3b17bc35fe req-9973cdac-e43f-452d-9b30-3d819e8ff6ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7aa85144-0ebe-430c-b9e5-9b656ea4560a", "tag": "e5a6930c-e135-4546-bcdc-823bfe4c6e87"}]} {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:50:46.331678 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [req-36b12600-2a1f-4bed-806d-8c3b17bc35fe req-9973cdac-e43f-452d-9b30-3d819e8ff6ad service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:46.332119 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [req-36b12600-2a1f-4bed-806d-8c3b17bc35fe req-9973cdac-e43f-452d-9b30-3d819e8ff6ad service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:46.343222 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.compute.server_external_events [req-36b12600-2a1f-4bed-806d-8c3b17bc35fe req-9973cdac-e43f-452d-9b30-3d819e8ff6ad service nova] Creating event network-changed:e5a6930c-e135-4546-bcdc-823bfe4c6e87 for instance 7aa85144-0ebe-430c-b9e5-9b656ea4560a on hv-cinder-81571 May 26 12:50:46.348492 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [req-36b12600-2a1f-4bed-806d-8c3b17bc35fe req-9973cdac-e43f-452d-9b30-3d819e8ff6ad service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029511 May 26 12:50:46.349072 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 269/542] 10.222.0.41 () {64 vars in 1317 bytes} [Thu May 26 12:50:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:50:46.987057 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-e766ce0b-0e5e-4078-a12d-e15faf803c1c tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:46.987673 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-e766ce0b-0e5e-4078-a12d-e15faf803c1c tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 73592c9c-6dae-4521-a03d-e02749530cac] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:46.994639 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-e766ce0b-0e5e-4078-a12d-e15faf803c1c tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:46.997829 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-e766ce0b-0e5e-4078-a12d-e15faf803c1c tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:46.997829 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-e766ce0b-0e5e-4078-a12d-e15faf803c1c tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:46.997829 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-e766ce0b-0e5e-4078-a12d-e15faf803c1c tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:47.040418 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-8bbe0385-1c33-415f-8a52-80dfd015a0d4 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:47.041245 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-8bbe0385-1c33-415f-8a52-80dfd015a0d4 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: 1b2f404c-1ca9-4904-944c-16685c8f68c5] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:47.048137 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-8bbe0385-1c33-415f-8a52-80dfd015a0d4 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:47.048663 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-8bbe0385-1c33-415f-8a52-80dfd015a0d4 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:47.049500 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-8bbe0385-1c33-415f-8a52-80dfd015a0d4 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:47.050029 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-8bbe0385-1c33-415f-8a52-80dfd015a0d4 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:47.062099 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-e766ce0b-0e5e-4078-a12d-e15faf803c1c tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:47.070496 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-e766ce0b-0e5e-4078-a12d-e15faf803c1c tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:47.072050 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-e766ce0b-0e5e-4078-a12d-e15faf803c1c tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:47.073212 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-e766ce0b-0e5e-4078-a12d-e15faf803c1c tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac" status: 200 len: 1342 microversion: 2.20 time: 0.090405 May 26 12:50:47.073886 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 274/543] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:50:46 2022] GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac => generated 1342 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:50:47.169980 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-1c5c3fe3-71d2-4df5-bbe2-6032bc37aa72 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:47.170592 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-1c5c3fe3-71d2-4df5-bbe2-6032bc37aa72 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] [instance: 4d941693-7aca-4eb9-b1eb-5add0d24b5c1] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:47.176570 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-1c5c3fe3-71d2-4df5-bbe2-6032bc37aa72 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:47.177041 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-1c5c3fe3-71d2-4df5-bbe2-6032bc37aa72 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:47.177814 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-1c5c3fe3-71d2-4df5-bbe2-6032bc37aa72 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:47.178250 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-1c5c3fe3-71d2-4df5-bbe2-6032bc37aa72 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:47.195910 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-8bbe0385-1c33-415f-8a52-80dfd015a0d4 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0537911b91184fcdbdcc9e93ec3fe5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad768b45d17480d8d6bbbcff6032c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:47.203363 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-8bbe0385-1c33-415f-8a52-80dfd015a0d4 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "GET /compute/v2.1/servers/1b2f404c-1ca9-4904-944c-16685c8f68c5" status: 200 len: 1366 microversion: 2.1 time: 0.167743 May 26 12:50:47.203943 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 270/544] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:50:47 2022] GET /compute/v2.1/servers/1b2f404c-1ca9-4904-944c-16685c8f68c5 => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:50:47.213421 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-1c5c3fe3-71d2-4df5-bbe2-6032bc37aa72 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:47.213918 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-1c5c3fe3-71d2-4df5-bbe2-6032bc37aa72 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:47.214439 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.objects.instance [None req-1c5c3fe3-71d2-4df5-bbe2-6032bc37aa72 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lazy-loading 'fault' on Instance uuid 4d941693-7aca-4eb9-b1eb-5add0d24b5c1 {{(pid=124823) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:50:47.256490 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-1c5c3fe3-71d2-4df5-bbe2-6032bc37aa72 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646a9abb1f9d4a1295a04defd895ff7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd539dfec943a44eb9b025d842a1f858d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:47.264023 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-1c5c3fe3-71d2-4df5-bbe2-6032bc37aa72 tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] 10.222.0.41 "GET /compute/v2.1/servers/4d941693-7aca-4eb9-b1eb-5add0d24b5c1" status: 200 len: 1309 microversion: 2.1 time: 0.097941 May 26 12:50:47.264588 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 275/545] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:50:47 2022] GET /compute/v2.1/servers/4d941693-7aca-4eb9-b1eb-5add0d24b5c1 => generated 1309 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:48.092452 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-0ec8aee3-b1bf-4981-9dba-716568acfd03 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:48.093076 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-0ec8aee3-b1bf-4981-9dba-716568acfd03 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 73592c9c-6dae-4521-a03d-e02749530cac] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:48.101285 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-0ec8aee3-b1bf-4981-9dba-716568acfd03 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:48.102084 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-0ec8aee3-b1bf-4981-9dba-716568acfd03 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:48.102885 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-0ec8aee3-b1bf-4981-9dba-716568acfd03 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:48.103319 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-0ec8aee3-b1bf-4981-9dba-716568acfd03 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:48.177838 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-0ec8aee3-b1bf-4981-9dba-716568acfd03 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:48.186680 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-0ec8aee3-b1bf-4981-9dba-716568acfd03 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:48.188307 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-0ec8aee3-b1bf-4981-9dba-716568acfd03 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:48.189423 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-0ec8aee3-b1bf-4981-9dba-716568acfd03 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac" status: 200 len: 1340 microversion: 2.20 time: 0.101267 May 26 12:50:48.190013 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 271/546] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:50:48 2022] GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac => generated 1340 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:50:48.220498 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-f35e1b64-e26a-4381-b387-59ce5fc11cb0 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:48.221139 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-f35e1b64-e26a-4381-b387-59ce5fc11cb0 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: 1b2f404c-1ca9-4904-944c-16685c8f68c5] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:48.228737 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-f35e1b64-e26a-4381-b387-59ce5fc11cb0 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:48.229186 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-f35e1b64-e26a-4381-b387-59ce5fc11cb0 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:48.229984 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-f35e1b64-e26a-4381-b387-59ce5fc11cb0 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:48.230421 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-f35e1b64-e26a-4381-b387-59ce5fc11cb0 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:48.287310 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-17737b66-a9ec-4949-95f5-80c555265acf tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:48.288085 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-17737b66-a9ec-4949-95f5-80c555265acf tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] [instance: 4d941693-7aca-4eb9-b1eb-5add0d24b5c1] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:48.296062 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-17737b66-a9ec-4949-95f5-80c555265acf tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:48.296517 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-17737b66-a9ec-4949-95f5-80c555265acf tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:48.297296 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-17737b66-a9ec-4949-95f5-80c555265acf tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:48.297757 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-17737b66-a9ec-4949-95f5-80c555265acf tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:48.316569 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.wsgi [None req-17737b66-a9ec-4949-95f5-80c555265acf tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] HTTP exception thrown: Instance 4d941693-7aca-4eb9-b1eb-5add0d24b5c1 could not be found. May 26 12:50:48.318723 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-17737b66-a9ec-4949-95f5-80c555265acf tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Request method failure captured: May 26 12:50:48.318723 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: request: GET /compute/v2.1/servers/4d941693-7aca-4eb9-b1eb-5add0d24b5c1 HTTP/1.1 May 26 12:50:48.318723 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Accept: application/json May 26 12:50:48.318723 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Accept-Encoding: identity May 26 12:50:48.318723 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Connection: close May 26 12:50:48.318723 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Content-Length: 0 May 26 12:50:48.318723 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Content-Type: application/json May 26 12:50:48.318723 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Host: 10.222.0.41 May 26 12:50:48.318723 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Openstack-System-Scope: None May 26 12:50:48.318723 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: User-Agent: python-urllib3/1.26.9 May 26 12:50:48.318723 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Auth-Token: gAAAAABij3cLuxa3iBFkQynmTv9WriK4EgE9beFjBLMZ8d4bdD4k8a0ptpwAH2NN8n4K1nsFpNLs84sh6G0PBMtH3yF9Q0ynab-1NYFN5tv2enSQ0eEX1TFE87MKUp-sUK6gGTxgIB62qh1zuYspXmNMpyQrvHBgqO2x_-GRG_xVxQT13jdcAzM May 26 12:50:48.318723 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Domain-Id: None May 26 12:50:48.318723 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Domain-Name: None May 26 12:50:48.318723 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Identity-Status: Confirmed May 26 12:50:48.318723 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Is-Admin-Project: True May 26 12:50:48.318723 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Domain-Id: default May 26 12:50:48.318723 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Domain-Name: Default May 26 12:50:48.318723 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Id: d539dfec943a44eb9b025d842a1f858d May 26 12:50:48.318723 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Name: tempest-VolumesSnapshotTestJSON-601418415 May 26 12:50:48.318723 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Role: member,reader May 26 12:50:48.318723 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Roles: member,reader May 26 12:50:48.320272 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/d539dfec943a44eb9b025d842a1f858d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/d539dfec943a44eb9b025d842a1f858d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/d539dfec943a44eb9b025d842a1f858d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_d539dfec943a44eb9b025d842a1f858d", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 26 12:50:48.320272 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Tenant: tempest-VolumesSnapshotTestJSON-601418415 May 26 12:50:48.320272 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Tenant-Id: d539dfec943a44eb9b025d842a1f858d May 26 12:50:48.320272 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-601418415 May 26 12:50:48.320272 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User: tempest-VolumesSnapshotTestJSON-601418415-project May 26 12:50:48.320272 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Domain-Id: default May 26 12:50:48.320272 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Domain-Name: Default May 26 12:50:48.320272 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Id: 646a9abb1f9d4a1295a04defd895ff7c May 26 12:50:48.320272 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Name: tempest-VolumesSnapshotTestJSON-601418415-project May 26 12:50:48.320272 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: method: > May 26 12:50:48.320272 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: exception: Instance 4d941693-7aca-4eb9-b1eb-5add0d24b5c1 could not be found. May 26 12:50:48.320272 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: action_args: {'id': '4d941693-7aca-4eb9-b1eb-5add0d24b5c1'} May 26 12:50:48.321245 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:50:48.321245 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:50:48.321245 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:50:48.321245 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:50:48.321245 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:50:48.321245 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:50:48.321245 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:50:48.321245 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:50:48.321245 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:50:48.321245 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:50:48.321245 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d941693-7aca-4eb9-b1eb-5add0d24b5c1 could not be found. May 26 12:50:48.321245 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:50:48.321245 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:50:48.321245 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:50:48.321245 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:50:48.321245 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:50:48.321245 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:50:48.321245 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:50:48.321245 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:50:48.321245 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:50:48.322407 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:50:48.322407 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 12:50:48.322407 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 12:50:48.322407 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:50:48.322407 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:50:48.322407 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:50:48.322407 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:50:48.322407 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d941693-7aca-4eb9-b1eb-5add0d24b5c1 could not be found. May 26 12:50:48.322407 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:50:48.322407 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:50:48.322407 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:50:48.322407 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:50:48.322407 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:50:48.322407 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:50:48.322407 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:50:48.322407 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:50:48.322407 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d941693-7aca-4eb9-b1eb-5add0d24b5c1 could not be found. May 26 12:50:48.322407 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:50:48.324586 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-17737b66-a9ec-4949-95f5-80c555265acf tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] Returning 404 to user: Instance 4d941693-7aca-4eb9-b1eb-5add0d24b5c1 could not be found. {{(pid=124824) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:50:48.325877 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-17737b66-a9ec-4949-95f5-80c555265acf tempest-VolumesSnapshotTestJSON-601418415 tempest-VolumesSnapshotTestJSON-601418415-project] 10.222.0.41 "GET /compute/v2.1/servers/4d941693-7aca-4eb9-b1eb-5add0d24b5c1" status: 404 len: 111 microversion: 2.1 time: 0.042925 May 26 12:50:48.326564 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 272/547] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:50:48 2022] GET /compute/v2.1/servers/4d941693-7aca-4eb9-b1eb-5add0d24b5c1 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 12:50:48.481414 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-f35e1b64-e26a-4381-b387-59ce5fc11cb0 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0537911b91184fcdbdcc9e93ec3fe5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad768b45d17480d8d6bbbcff6032c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:48.507576 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-f35e1b64-e26a-4381-b387-59ce5fc11cb0 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "GET /compute/v2.1/servers/1b2f404c-1ca9-4904-944c-16685c8f68c5" status: 200 len: 1555 microversion: 2.1 time: 0.290894 May 26 12:50:48.508902 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 276/548] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:50:48 2022] GET /compute/v2.1/servers/1b2f404c-1ca9-4904-944c-16685c8f68c5 => generated 1555 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:50:48.524491 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-af384a7b-1f19-49d5-a0d6-c8ef1d86fc75 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:48.529617 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-af384a7b-1f19-49d5-a0d6-c8ef1d86fc75 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: 1b2f404c-1ca9-4904-944c-16685c8f68c5] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:48.531743 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-af384a7b-1f19-49d5-a0d6-c8ef1d86fc75 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:48.532456 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-af384a7b-1f19-49d5-a0d6-c8ef1d86fc75 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:48.533361 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-af384a7b-1f19-49d5-a0d6-c8ef1d86fc75 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:48.533685 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-af384a7b-1f19-49d5-a0d6-c8ef1d86fc75 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:48.629730 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-af384a7b-1f19-49d5-a0d6-c8ef1d86fc75 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "GET /compute/v2.1/servers/1b2f404c-1ca9-4904-944c-16685c8f68c5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.109631 May 26 12:50:48.630814 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 273/549] 10.222.0.41 () {58 vars in 1274 bytes} [Thu May 26 12:50:48 2022] GET /compute/v2.1/servers/1b2f404c-1ca9-4904-944c-16685c8f68c5/os-interface => generated 284 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:50:49.207899 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-5cddeaa5-6354-4dd1-982f-8c1db1c7ad29 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:49.208609 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-5cddeaa5-6354-4dd1-982f-8c1db1c7ad29 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 73592c9c-6dae-4521-a03d-e02749530cac] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:49.215484 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-5cddeaa5-6354-4dd1-982f-8c1db1c7ad29 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:49.215929 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-5cddeaa5-6354-4dd1-982f-8c1db1c7ad29 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:49.216896 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-5cddeaa5-6354-4dd1-982f-8c1db1c7ad29 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:49.217341 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-5cddeaa5-6354-4dd1-982f-8c1db1c7ad29 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:49.432966 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-5cddeaa5-6354-4dd1-982f-8c1db1c7ad29 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:49.440920 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-5cddeaa5-6354-4dd1-982f-8c1db1c7ad29 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:49.442622 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-5cddeaa5-6354-4dd1-982f-8c1db1c7ad29 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:49.444467 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-5cddeaa5-6354-4dd1-982f-8c1db1c7ad29 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac" status: 200 len: 1407 microversion: 2.20 time: 0.240622 May 26 12:50:49.445262 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 277/550] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:50:49 2022] GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac => generated 1407 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:50:49.555423 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [req-207aa167-d1ea-4d9a-b282-77e55c36b123 req-d207904c-6049-4f4d-a7fc-40145231289c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73592c9c-6dae-4521-a03d-e02749530cac", "tag": "d2fc86c7-8d2d-4221-a19f-e4847de64091"}]} {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:50:49.583682 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG dbcounter [-] [124824] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=124824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:50:49.590629 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [req-207aa167-d1ea-4d9a-b282-77e55c36b123 req-d207904c-6049-4f4d-a7fc-40145231289c service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:49.591065 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [req-207aa167-d1ea-4d9a-b282-77e55c36b123 req-d207904c-6049-4f4d-a7fc-40145231289c service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:49.614185 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.compute.server_external_events [req-207aa167-d1ea-4d9a-b282-77e55c36b123 req-d207904c-6049-4f4d-a7fc-40145231289c service nova] Creating event network-changed:d2fc86c7-8d2d-4221-a19f-e4847de64091 for instance 73592c9c-6dae-4521-a03d-e02749530cac on hv-cinder-81571 May 26 12:50:49.621415 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [req-207aa167-d1ea-4d9a-b282-77e55c36b123 req-d207904c-6049-4f4d-a7fc-40145231289c service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075552 May 26 12:50:49.622379 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 274/551] 10.222.0.41 () {64 vars in 1317 bytes} [Thu May 26 12:50:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:50:50.134366 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [req-f5dedc18-cb79-4c34-b052-6c8fca343e38 req-87b2005b-2ae4-4924-9203-18478293ff2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b2f404c-1ca9-4904-944c-16685c8f68c5", "tag": "a3a568a1-60df-415d-9fd4-02eab3f0bfce"}]} {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:50:50.143430 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [req-f5dedc18-cb79-4c34-b052-6c8fca343e38 req-87b2005b-2ae4-4924-9203-18478293ff2e service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:50.143958 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [req-f5dedc18-cb79-4c34-b052-6c8fca343e38 req-87b2005b-2ae4-4924-9203-18478293ff2e service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:50.156366 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.compute.server_external_events [req-f5dedc18-cb79-4c34-b052-6c8fca343e38 req-87b2005b-2ae4-4924-9203-18478293ff2e service nova] Creating event network-changed:a3a568a1-60df-415d-9fd4-02eab3f0bfce for instance 1b2f404c-1ca9-4904-944c-16685c8f68c5 on hv-cinder-81571 May 26 12:50:50.161485 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [req-f5dedc18-cb79-4c34-b052-6c8fca343e38 req-87b2005b-2ae4-4924-9203-18478293ff2e service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031186 May 26 12:50:50.162424 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 278/552] 10.222.0.41 () {64 vars in 1317 bytes} [Thu May 26 12:50:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:50:50.468381 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-c40e3bcf-0fc3-4298-bf0d-8105b7ef41ed tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:50.470955 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-c40e3bcf-0fc3-4298-bf0d-8105b7ef41ed tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 73592c9c-6dae-4521-a03d-e02749530cac] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:50.483139 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-c40e3bcf-0fc3-4298-bf0d-8105b7ef41ed tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:50.483342 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-c40e3bcf-0fc3-4298-bf0d-8105b7ef41ed tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:50.487565 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-c40e3bcf-0fc3-4298-bf0d-8105b7ef41ed tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:50.487565 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-c40e3bcf-0fc3-4298-bf0d-8105b7ef41ed tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:50.688771 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-c40e3bcf-0fc3-4298-bf0d-8105b7ef41ed tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:50.696960 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-c40e3bcf-0fc3-4298-bf0d-8105b7ef41ed tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:50.699556 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-c40e3bcf-0fc3-4298-bf0d-8105b7ef41ed tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:50.700795 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-c40e3bcf-0fc3-4298-bf0d-8105b7ef41ed tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac" status: 200 len: 1407 microversion: 2.20 time: 0.242277 May 26 12:50:50.701356 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 275/553] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:50:50 2022] GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac => generated 1407 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:50:51.721111 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-40544dfc-6c27-479d-a516-7a52c91afb8c tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:51.735817 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-40544dfc-6c27-479d-a516-7a52c91afb8c tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 73592c9c-6dae-4521-a03d-e02749530cac] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:51.735817 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-40544dfc-6c27-479d-a516-7a52c91afb8c tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:51.735817 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-40544dfc-6c27-479d-a516-7a52c91afb8c tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:51.735817 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-40544dfc-6c27-479d-a516-7a52c91afb8c tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:51.736184 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-40544dfc-6c27-479d-a516-7a52c91afb8c tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:51.870417 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-40544dfc-6c27-479d-a516-7a52c91afb8c tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:51.878441 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-40544dfc-6c27-479d-a516-7a52c91afb8c tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:51.879975 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-40544dfc-6c27-479d-a516-7a52c91afb8c tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:51.881078 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-40544dfc-6c27-479d-a516-7a52c91afb8c tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac" status: 200 len: 1407 microversion: 2.20 time: 0.165787 May 26 12:50:51.881636 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 279/554] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:50:51 2022] GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:50:52.901027 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-4a69716d-785f-41cc-b22b-161d2f39f99d tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:52.901644 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-4a69716d-785f-41cc-b22b-161d2f39f99d tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 73592c9c-6dae-4521-a03d-e02749530cac] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:52.904797 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG dbcounter [-] [124824] Writing DB stats nova_cell0:SELECT=2 {{(pid=124824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:50:52.910193 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-4a69716d-785f-41cc-b22b-161d2f39f99d tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:52.910837 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-4a69716d-785f-41cc-b22b-161d2f39f99d tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:52.911630 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-4a69716d-785f-41cc-b22b-161d2f39f99d tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:52.912429 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-4a69716d-785f-41cc-b22b-161d2f39f99d tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:53.044527 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-4a69716d-785f-41cc-b22b-161d2f39f99d tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:53.055687 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-4a69716d-785f-41cc-b22b-161d2f39f99d tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:53.070217 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-4a69716d-785f-41cc-b22b-161d2f39f99d tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:53.070217 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-4a69716d-785f-41cc-b22b-161d2f39f99d tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac" status: 200 len: 1407 microversion: 2.20 time: 0.163211 May 26 12:50:53.070217 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 276/555] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:50:52 2022] GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:50:54.074811 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG dbcounter [-] [124823] Writing DB stats nova_cell0:SELECT=2 {{(pid=124823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:50:54.076643 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG dbcounter [-] [124823] Writing DB stats nova_cell0:SELECT=10 {{(pid=124823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:50:54.081910 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-205be3cd-55dd-43fa-b64e-e521fea9645e tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:54.082840 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-205be3cd-55dd-43fa-b64e-e521fea9645e tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 73592c9c-6dae-4521-a03d-e02749530cac] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:54.089787 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-205be3cd-55dd-43fa-b64e-e521fea9645e tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:54.090235 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-205be3cd-55dd-43fa-b64e-e521fea9645e tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:54.091286 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-205be3cd-55dd-43fa-b64e-e521fea9645e tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:54.091808 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-205be3cd-55dd-43fa-b64e-e521fea9645e tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:54.247716 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-205be3cd-55dd-43fa-b64e-e521fea9645e tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:54.257533 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-205be3cd-55dd-43fa-b64e-e521fea9645e tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:54.258927 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-205be3cd-55dd-43fa-b64e-e521fea9645e tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:54.260468 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-205be3cd-55dd-43fa-b64e-e521fea9645e tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac" status: 200 len: 1407 microversion: 2.20 time: 0.186212 May 26 12:50:54.261563 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 280/556] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:50:54 2022] GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac => generated 1407 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:50:55.279479 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-0c6a652e-743b-4002-ba0f-2b8ad807c025 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:55.280499 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-0c6a652e-743b-4002-ba0f-2b8ad807c025 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 73592c9c-6dae-4521-a03d-e02749530cac] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:55.288916 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-0c6a652e-743b-4002-ba0f-2b8ad807c025 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:55.289629 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-0c6a652e-743b-4002-ba0f-2b8ad807c025 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:55.290884 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-0c6a652e-743b-4002-ba0f-2b8ad807c025 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:55.291318 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-0c6a652e-743b-4002-ba0f-2b8ad807c025 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:55.494925 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-0c6a652e-743b-4002-ba0f-2b8ad807c025 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:55.507728 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-0c6a652e-743b-4002-ba0f-2b8ad807c025 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:55.509312 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-0c6a652e-743b-4002-ba0f-2b8ad807c025 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:55.510494 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-0c6a652e-743b-4002-ba0f-2b8ad807c025 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac" status: 200 len: 1407 microversion: 2.20 time: 0.235038 May 26 12:50:55.511261 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 277/557] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:50:55 2022] GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac => generated 1407 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:50:56.530842 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-6bc0915e-3ab4-4f1b-89b1-f29c8770fe26 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:56.531977 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-6bc0915e-3ab4-4f1b-89b1-f29c8770fe26 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 73592c9c-6dae-4521-a03d-e02749530cac] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:56.540576 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-6bc0915e-3ab4-4f1b-89b1-f29c8770fe26 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:56.541125 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-6bc0915e-3ab4-4f1b-89b1-f29c8770fe26 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:56.542059 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-6bc0915e-3ab4-4f1b-89b1-f29c8770fe26 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:56.542570 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-6bc0915e-3ab4-4f1b-89b1-f29c8770fe26 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:56.719953 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-6bc0915e-3ab4-4f1b-89b1-f29c8770fe26 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:56.731086 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-6bc0915e-3ab4-4f1b-89b1-f29c8770fe26 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:56.732439 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-6bc0915e-3ab4-4f1b-89b1-f29c8770fe26 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:56.733995 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-6bc0915e-3ab4-4f1b-89b1-f29c8770fe26 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac" status: 200 len: 1407 microversion: 2.20 time: 0.209219 May 26 12:50:56.739490 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 281/558] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:50:56 2022] GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac => generated 1407 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:50:57.752178 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-b74112e5-4f85-4847-b527-399deebe515c tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:57.752794 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-b74112e5-4f85-4847-b527-399deebe515c tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 73592c9c-6dae-4521-a03d-e02749530cac] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:57.760291 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-b74112e5-4f85-4847-b527-399deebe515c tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:57.760814 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-b74112e5-4f85-4847-b527-399deebe515c tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:57.761843 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-b74112e5-4f85-4847-b527-399deebe515c tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:57.762347 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-b74112e5-4f85-4847-b527-399deebe515c tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:57.900568 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-b74112e5-4f85-4847-b527-399deebe515c tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:57.911464 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-b74112e5-4f85-4847-b527-399deebe515c tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:57.913462 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-b74112e5-4f85-4847-b527-399deebe515c tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:57.954000 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-b74112e5-4f85-4847-b527-399deebe515c tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac" status: 200 len: 1407 microversion: 2.20 time: 0.166549 May 26 12:50:57.954000 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 278/559] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:50:57 2022] GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac => generated 1407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:50:58.970351 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-13b9c4a5-91a0-45a4-9f4b-110f311ff218 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:50:58.970965 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-13b9c4a5-91a0-45a4-9f4b-110f311ff218 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 73592c9c-6dae-4521-a03d-e02749530cac] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:50:58.980062 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-13b9c4a5-91a0-45a4-9f4b-110f311ff218 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:58.980613 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-13b9c4a5-91a0-45a4-9f4b-110f311ff218 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:58.981460 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-13b9c4a5-91a0-45a4-9f4b-110f311ff218 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:58.981991 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-13b9c4a5-91a0-45a4-9f4b-110f311ff218 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:59.152590 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-13b9c4a5-91a0-45a4-9f4b-110f311ff218 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:59.166258 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-13b9c4a5-91a0-45a4-9f4b-110f311ff218 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:59.170281 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-13b9c4a5-91a0-45a4-9f4b-110f311ff218 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:50:59.171899 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-13b9c4a5-91a0-45a4-9f4b-110f311ff218 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac" status: 200 len: 1407 microversion: 2.20 time: 0.205340 May 26 12:50:59.173063 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 282/560] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:50:58 2022] GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac => generated 1407 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:50:59.649175 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [req-c5e79c99-a206-4f47-ad47-40d7b296b606 req-e8042596-343e-4cfe-b98b-1a1fdc39804d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73592c9c-6dae-4521-a03d-e02749530cac", "name": "network-vif-plugged", "status": "completed", "tag": "d2fc86c7-8d2d-4221-a19f-e4847de64091"}]} {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:50:59.664618 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [req-c5e79c99-a206-4f47-ad47-40d7b296b606 req-e8042596-343e-4cfe-b98b-1a1fdc39804d service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:50:59.665446 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [req-c5e79c99-a206-4f47-ad47-40d7b296b606 req-e8042596-343e-4cfe-b98b-1a1fdc39804d service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:50:59.680928 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.compute.server_external_events [req-c5e79c99-a206-4f47-ad47-40d7b296b606 req-e8042596-343e-4cfe-b98b-1a1fdc39804d service nova] Creating event network-vif-plugged:d2fc86c7-8d2d-4221-a19f-e4847de64091 for instance 73592c9c-6dae-4521-a03d-e02749530cac on hv-cinder-81571 May 26 12:50:59.686683 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [req-c5e79c99-a206-4f47-ad47-40d7b296b606 req-e8042596-343e-4cfe-b98b-1a1fdc39804d service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041307 May 26 12:50:59.687979 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 279/561] 10.222.0.41 () {64 vars in 1317 bytes} [Thu May 26 12:50:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:51:00.193596 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-cde95cae-2ac4-4d62-a035-24a0cb0b050f tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:00.194241 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-cde95cae-2ac4-4d62-a035-24a0cb0b050f tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 73592c9c-6dae-4521-a03d-e02749530cac] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:00.205779 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-cde95cae-2ac4-4d62-a035-24a0cb0b050f tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:00.206518 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-cde95cae-2ac4-4d62-a035-24a0cb0b050f tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:00.207481 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-cde95cae-2ac4-4d62-a035-24a0cb0b050f tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:00.210352 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-cde95cae-2ac4-4d62-a035-24a0cb0b050f tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:00.456713 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-cde95cae-2ac4-4d62-a035-24a0cb0b050f tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:00.467001 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-cde95cae-2ac4-4d62-a035-24a0cb0b050f tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:00.468586 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-cde95cae-2ac4-4d62-a035-24a0cb0b050f tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:00.470088 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-cde95cae-2ac4-4d62-a035-24a0cb0b050f tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac" status: 200 len: 1407 microversion: 2.20 time: 0.280097 May 26 12:51:00.481595 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 283/562] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:51:00 2022] GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac => generated 1407 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:51:01.490119 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-a076c460-a3ac-4013-924b-0f276fd0b79c tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:01.490809 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-a076c460-a3ac-4013-924b-0f276fd0b79c tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 73592c9c-6dae-4521-a03d-e02749530cac] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:01.497640 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-a076c460-a3ac-4013-924b-0f276fd0b79c tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:01.498134 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-a076c460-a3ac-4013-924b-0f276fd0b79c tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:01.498899 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-a076c460-a3ac-4013-924b-0f276fd0b79c tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:01.499333 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-a076c460-a3ac-4013-924b-0f276fd0b79c tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:01.648386 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-a076c460-a3ac-4013-924b-0f276fd0b79c tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:01.658974 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-a076c460-a3ac-4013-924b-0f276fd0b79c tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:01.660497 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-a076c460-a3ac-4013-924b-0f276fd0b79c tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:01.661846 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-a076c460-a3ac-4013-924b-0f276fd0b79c tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac" status: 200 len: 1407 microversion: 2.20 time: 0.176421 May 26 12:51:01.662418 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 280/563] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:51:01 2022] GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac => generated 1407 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:51:02.681278 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-66d523b3-9bc8-40af-a86f-6b39170681e7 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:02.682557 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-66d523b3-9bc8-40af-a86f-6b39170681e7 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 73592c9c-6dae-4521-a03d-e02749530cac] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:02.689739 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-66d523b3-9bc8-40af-a86f-6b39170681e7 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:02.690687 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-66d523b3-9bc8-40af-a86f-6b39170681e7 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:02.699047 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-66d523b3-9bc8-40af-a86f-6b39170681e7 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:02.699917 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-66d523b3-9bc8-40af-a86f-6b39170681e7 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:02.998995 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-66d523b3-9bc8-40af-a86f-6b39170681e7 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:03.006033 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG dbcounter [-] [124823] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:51:03.009006 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-66d523b3-9bc8-40af-a86f-6b39170681e7 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:03.010896 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-66d523b3-9bc8-40af-a86f-6b39170681e7 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:03.012516 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-66d523b3-9bc8-40af-a86f-6b39170681e7 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac" status: 200 len: 1407 microversion: 2.20 time: 0.335635 May 26 12:51:03.023107 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 284/564] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:51:02 2022] GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac => generated 1407 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:51:04.031364 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-0a1730c4-0a80-4e17-94ba-47e404ccff82 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:04.032041 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-0a1730c4-0a80-4e17-94ba-47e404ccff82 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 73592c9c-6dae-4521-a03d-e02749530cac] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:04.040765 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-0a1730c4-0a80-4e17-94ba-47e404ccff82 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:04.041952 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-0a1730c4-0a80-4e17-94ba-47e404ccff82 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:04.043007 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-0a1730c4-0a80-4e17-94ba-47e404ccff82 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:04.043638 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-0a1730c4-0a80-4e17-94ba-47e404ccff82 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:04.506720 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-0a1730c4-0a80-4e17-94ba-47e404ccff82 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:04.520871 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-0a1730c4-0a80-4e17-94ba-47e404ccff82 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:04.524413 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-0a1730c4-0a80-4e17-94ba-47e404ccff82 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:04.526114 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-0a1730c4-0a80-4e17-94ba-47e404ccff82 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac" status: 200 len: 1407 microversion: 2.20 time: 0.498629 May 26 12:51:04.542321 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 281/565] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:51:04 2022] GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac => generated 1407 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:51:05.001712 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-c06dfc0b-0151-4ced-b8cf-ecbcb949691a tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Action: 'create', calling method: .version_select at 0x7f26a1e271f0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1054937962", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBoY6MhjiN3Q6N+ZAe53n3BJ6PhrROgxrHslL6H7Ca7ELeau7rqWrfSk3hn1h8aEzs8DGYi9XIYAu0VhJoqLkX6LAKvuCEQRdXH1JnLirQNGTtlI2z+EBJVArgARAUSLQw=="}} {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:51:05.016723 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.quota [None req-c06dfc0b-0151-4ced-b8cf-ecbcb949691a tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Getting quotas for project 23568023763549669484e71430e34389. Resources: {'key_pairs'} {{(pid=124823) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:51:05.021429 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.quota [None req-c06dfc0b-0151-4ced-b8cf-ecbcb949691a tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Getting quotas for user b47d51863b0448b880dc03b01dec6dc5 and project 23568023763549669484e71430e34389. Resources: {'key_pairs'} {{(pid=124823) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:51:05.391697 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-c06dfc0b-0151-4ced-b8cf-ecbcb949691a tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.581968 May 26 12:51:05.392549 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 285/566] 10.222.0.41 () {60 vars in 1158 bytes} [Thu May 26 12:51:04 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:51:05.544236 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-ab7f0ea1-c66d-4e42-9fb9-5ac81d9848f9 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:05.545185 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-ab7f0ea1-c66d-4e42-9fb9-5ac81d9848f9 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 73592c9c-6dae-4521-a03d-e02749530cac] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:05.551657 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-ab7f0ea1-c66d-4e42-9fb9-5ac81d9848f9 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:05.552351 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-ab7f0ea1-c66d-4e42-9fb9-5ac81d9848f9 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:05.553531 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-ab7f0ea1-c66d-4e42-9fb9-5ac81d9848f9 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:05.554088 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-ab7f0ea1-c66d-4e42-9fb9-5ac81d9848f9 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:05.579422 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG dbcounter [-] [124824] Writing DB stats nova_cell1:SELECT=100 {{(pid=124824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:51:05.700790 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-ab7f0ea1-c66d-4e42-9fb9-5ac81d9848f9 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:05.709621 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-ab7f0ea1-c66d-4e42-9fb9-5ac81d9848f9 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:05.711307 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-ab7f0ea1-c66d-4e42-9fb9-5ac81d9848f9 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:05.712390 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-ab7f0ea1-c66d-4e42-9fb9-5ac81d9848f9 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac" status: 200 len: 1600 microversion: 2.20 time: 0.172006 May 26 12:51:05.712942 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 282/567] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:51:05 2022] GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac => generated 1600 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:51:05.730967 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-1e357753-14cf-45de-9f09-78de97e0e453 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:05.731557 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-1e357753-14cf-45de-9f09-78de97e0e453 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 73592c9c-6dae-4521-a03d-e02749530cac] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:05.738853 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-1e357753-14cf-45de-9f09-78de97e0e453 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:05.739512 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-1e357753-14cf-45de-9f09-78de97e0e453 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:05.740304 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-1e357753-14cf-45de-9f09-78de97e0e453 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:05.740735 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-1e357753-14cf-45de-9f09-78de97e0e453 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:05.836403 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-1e357753-14cf-45de-9f09-78de97e0e453 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.109428 May 26 12:51:05.837004 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 286/568] 10.222.0.41 () {60 vars in 1315 bytes} [Thu May 26 12:51:05 2022] GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac/os-interface => generated 285 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 12:51:07.133475 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [req-edaca2a1-fbd5-40ff-bc41-fed7079b9b0a req-59d3e5c2-6e74-48e5-b189-df26f23eb6c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73592c9c-6dae-4521-a03d-e02749530cac", "tag": "d2fc86c7-8d2d-4221-a19f-e4847de64091"}]} {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:51:07.143129 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [req-edaca2a1-fbd5-40ff-bc41-fed7079b9b0a req-59d3e5c2-6e74-48e5-b189-df26f23eb6c8 service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:07.143879 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [req-edaca2a1-fbd5-40ff-bc41-fed7079b9b0a req-59d3e5c2-6e74-48e5-b189-df26f23eb6c8 service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:07.158759 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.compute.server_external_events [req-edaca2a1-fbd5-40ff-bc41-fed7079b9b0a req-59d3e5c2-6e74-48e5-b189-df26f23eb6c8 service nova] Creating event network-changed:d2fc86c7-8d2d-4221-a19f-e4847de64091 for instance 73592c9c-6dae-4521-a03d-e02749530cac on hv-cinder-81571 May 26 12:51:07.165086 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [req-edaca2a1-fbd5-40ff-bc41-fed7079b9b0a req-59d3e5c2-6e74-48e5-b189-df26f23eb6c8 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036431 May 26 12:51:07.166075 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 283/569] 10.222.0.41 () {64 vars in 1317 bytes} [Thu May 26 12:51:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:51:25.506749 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG dbcounter [-] [124823] Writing DB stats nova_cell0:SELECT=4 {{(pid=124823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:51:25.507505 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG dbcounter [-] [124823] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=124823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:51:25.508121 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG dbcounter [-] [124823] Writing DB stats nova_cell1:SELECT=4 {{(pid=124823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:51:25.512135 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-84b03266-f441-4281-9010-1f60f71ff5d8 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:25.512639 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-84b03266-f441-4281-9010-1f60f71ff5d8 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: 7aa85144-0ebe-430c-b9e5-9b656ea4560a] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:25.521931 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-84b03266-f441-4281-9010-1f60f71ff5d8 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:25.521931 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-84b03266-f441-4281-9010-1f60f71ff5d8 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:25.521931 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-84b03266-f441-4281-9010-1f60f71ff5d8 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:25.521931 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-84b03266-f441-4281-9010-1f60f71ff5d8 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:25.714253 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.objects.instance [None req-84b03266-f441-4281-9010-1f60f71ff5d8 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lazy-loading 'services' on Instance uuid 7aa85144-0ebe-430c-b9e5-9b656ea4560a {{(pid=124823) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:51:25.987278 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-84b03266-f441-4281-9010-1f60f71ff5d8 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "DELETE /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a/os-volume_attachments/bf9d0267-8ae1-4469-b8b5-3c906ecd3af1" status: 202 len: 0 microversion: 2.1 time: 0.481767 May 26 12:51:25.987869 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 287/570] 10.222.0.41 () {58 vars in 1415 bytes} [Thu May 26 12:51:25 2022] DELETE /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a/os-volume_attachments/bf9d0267-8ae1-4469-b8b5-3c906ecd3af1 => generated 0 bytes in 483 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 12:51:25.997059 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-e3f0b0b3-c656-48e4-be0b-ae19418ce691 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:25.998213 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-e3f0b0b3-c656-48e4-be0b-ae19418ce691 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: 7aa85144-0ebe-430c-b9e5-9b656ea4560a] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:26.000517 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG dbcounter [-] [124824] Writing DB stats nova_api:SELECT=18 {{(pid=124824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:51:26.001170 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG dbcounter [-] [124824] Writing DB stats nova_cell1:SELECT=4 {{(pid=124824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:51:26.006432 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-e3f0b0b3-c656-48e4-be0b-ae19418ce691 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:26.006881 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-e3f0b0b3-c656-48e4-be0b-ae19418ce691 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:26.007642 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-e3f0b0b3-c656-48e4-be0b-ae19418ce691 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:26.008074 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-e3f0b0b3-c656-48e4-be0b-ae19418ce691 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:26.038263 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-e3f0b0b3-c656-48e4-be0b-ae19418ce691 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045783 May 26 12:51:26.039619 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 284/571] 10.222.0.41 () {58 vars in 1301 bytes} [Thu May 26 12:51:25 2022] GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:51:27.058444 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-dd3ef233-0e7f-4d3f-9aba-67efc4d593c6 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:27.059418 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-dd3ef233-0e7f-4d3f-9aba-67efc4d593c6 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: 7aa85144-0ebe-430c-b9e5-9b656ea4560a] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:27.065738 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-dd3ef233-0e7f-4d3f-9aba-67efc4d593c6 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:27.066192 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-dd3ef233-0e7f-4d3f-9aba-67efc4d593c6 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:27.067009 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-dd3ef233-0e7f-4d3f-9aba-67efc4d593c6 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:27.067444 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-dd3ef233-0e7f-4d3f-9aba-67efc4d593c6 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:27.098246 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-dd3ef233-0e7f-4d3f-9aba-67efc4d593c6 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045192 May 26 12:51:27.098807 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 288/572] 10.222.0.41 () {58 vars in 1301 bytes} [Thu May 26 12:51:27 2022] GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:51:28.110706 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-72206c81-0e12-429d-bb7c-f57086f01655 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:28.111688 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-72206c81-0e12-429d-bb7c-f57086f01655 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: 7aa85144-0ebe-430c-b9e5-9b656ea4560a] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:28.118890 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-72206c81-0e12-429d-bb7c-f57086f01655 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:28.119325 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-72206c81-0e12-429d-bb7c-f57086f01655 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:28.120104 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-72206c81-0e12-429d-bb7c-f57086f01655 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:28.120534 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-72206c81-0e12-429d-bb7c-f57086f01655 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:28.150429 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-72206c81-0e12-429d-bb7c-f57086f01655 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044090 May 26 12:51:28.151519 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 285/573] 10.222.0.41 () {58 vars in 1301 bytes} [Thu May 26 12:51:28 2022] GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:51:29.162634 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-f4d3d08d-2281-4113-9d20-37b9c83268b6 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:29.163495 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-f4d3d08d-2281-4113-9d20-37b9c83268b6 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: 7aa85144-0ebe-430c-b9e5-9b656ea4560a] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:29.170662 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-f4d3d08d-2281-4113-9d20-37b9c83268b6 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:29.171113 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-f4d3d08d-2281-4113-9d20-37b9c83268b6 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:29.177656 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-f4d3d08d-2281-4113-9d20-37b9c83268b6 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:29.177656 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-f4d3d08d-2281-4113-9d20-37b9c83268b6 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:29.221399 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-f4d3d08d-2281-4113-9d20-37b9c83268b6 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062764 May 26 12:51:29.221983 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 289/574] 10.222.0.41 () {58 vars in 1301 bytes} [Thu May 26 12:51:29 2022] GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:51:30.233016 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-7d6992a1-a7d3-49b6-9838-5df049f24a2a tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:30.234070 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-7d6992a1-a7d3-49b6-9838-5df049f24a2a tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: 7aa85144-0ebe-430c-b9e5-9b656ea4560a] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:30.240457 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-7d6992a1-a7d3-49b6-9838-5df049f24a2a tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:30.240916 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-7d6992a1-a7d3-49b6-9838-5df049f24a2a tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:30.241679 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-7d6992a1-a7d3-49b6-9838-5df049f24a2a tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:30.242122 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-7d6992a1-a7d3-49b6-9838-5df049f24a2a tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:30.272797 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-7d6992a1-a7d3-49b6-9838-5df049f24a2a tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042414 May 26 12:51:30.272797 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 286/575] 10.222.0.41 () {58 vars in 1301 bytes} [Thu May 26 12:51:30 2022] GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:51:31.283310 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-e3298186-5953-4b29-8452-a05ef221b637 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:31.284177 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-e3298186-5953-4b29-8452-a05ef221b637 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: 7aa85144-0ebe-430c-b9e5-9b656ea4560a] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:31.290409 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-e3298186-5953-4b29-8452-a05ef221b637 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:31.290881 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-e3298186-5953-4b29-8452-a05ef221b637 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:31.291632 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-e3298186-5953-4b29-8452-a05ef221b637 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:31.292102 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-e3298186-5953-4b29-8452-a05ef221b637 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:31.320118 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-e3298186-5953-4b29-8452-a05ef221b637 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040882 May 26 12:51:31.320677 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 290/576] 10.222.0.41 () {58 vars in 1301 bytes} [Thu May 26 12:51:31 2022] GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 12:51:31.396918 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-5449c7f9-b495-4b7e-8484-1aa0ad73018b tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:31.397445 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-5449c7f9-b495-4b7e-8484-1aa0ad73018b tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: 7aa85144-0ebe-430c-b9e5-9b656ea4560a] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:31.404390 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-5449c7f9-b495-4b7e-8484-1aa0ad73018b tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:31.404833 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-5449c7f9-b495-4b7e-8484-1aa0ad73018b tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:31.405597 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-5449c7f9-b495-4b7e-8484-1aa0ad73018b tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:31.406061 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-5449c7f9-b495-4b7e-8484-1aa0ad73018b tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:31.431073 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-5449c7f9-b495-4b7e-8484-1aa0ad73018b tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: 7aa85144-0ebe-430c-b9e5-9b656ea4560a] Going to try to terminate instance {{(pid=124824) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 12:51:31.772225 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-5449c7f9-b495-4b7e-8484-1aa0ad73018b tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "DELETE /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a" status: 204 len: 0 microversion: 2.1 time: 0.378801 May 26 12:51:31.772833 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 287/577] 10.222.0.41 () {58 vars in 1238 bytes} [Thu May 26 12:51:31 2022] DELETE /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a => generated 0 bytes in 380 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 12:51:31.782352 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-5155aa2c-f439-4854-b4a0-583e095828ed tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:31.782970 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-5155aa2c-f439-4854-b4a0-583e095828ed tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: 7aa85144-0ebe-430c-b9e5-9b656ea4560a] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:31.789133 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-5155aa2c-f439-4854-b4a0-583e095828ed tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:31.789581 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-5155aa2c-f439-4854-b4a0-583e095828ed tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:31.790435 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-5155aa2c-f439-4854-b4a0-583e095828ed tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:31.790810 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-5155aa2c-f439-4854-b4a0-583e095828ed tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:31.921103 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-5155aa2c-f439-4854-b4a0-583e095828ed tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:31.928545 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-5155aa2c-f439-4854-b4a0-583e095828ed tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a" status: 200 len: 1688 microversion: 2.1 time: 0.150759 May 26 12:51:31.929108 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 291/578] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:51:31 2022] GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a => generated 1688 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:51:32.945620 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-00393fb4-f2f0-4ef2-b53f-06799a6f2ee5 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:32.946345 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-00393fb4-f2f0-4ef2-b53f-06799a6f2ee5 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: 7aa85144-0ebe-430c-b9e5-9b656ea4560a] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:32.953265 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-00393fb4-f2f0-4ef2-b53f-06799a6f2ee5 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:32.953724 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-00393fb4-f2f0-4ef2-b53f-06799a6f2ee5 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:32.954477 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-00393fb4-f2f0-4ef2-b53f-06799a6f2ee5 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:32.954906 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-00393fb4-f2f0-4ef2-b53f-06799a6f2ee5 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:33.097717 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-00393fb4-f2f0-4ef2-b53f-06799a6f2ee5 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:33.105873 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-00393fb4-f2f0-4ef2-b53f-06799a6f2ee5 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a" status: 200 len: 1688 microversion: 2.1 time: 0.164318 May 26 12:51:33.106462 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 288/579] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:51:32 2022] GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a => generated 1688 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:34.122813 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-9653680e-6fb2-4f31-ba01-c7b2845ea9f9 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:34.123458 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-9653680e-6fb2-4f31-ba01-c7b2845ea9f9 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: 7aa85144-0ebe-430c-b9e5-9b656ea4560a] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:34.129997 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-9653680e-6fb2-4f31-ba01-c7b2845ea9f9 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:34.130448 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-9653680e-6fb2-4f31-ba01-c7b2845ea9f9 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:34.131220 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-9653680e-6fb2-4f31-ba01-c7b2845ea9f9 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:34.131661 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-9653680e-6fb2-4f31-ba01-c7b2845ea9f9 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:34.258091 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-9653680e-6fb2-4f31-ba01-c7b2845ea9f9 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:34.265462 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-9653680e-6fb2-4f31-ba01-c7b2845ea9f9 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a" status: 200 len: 1688 microversion: 2.1 time: 0.146545 May 26 12:51:34.266074 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 292/580] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:51:34 2022] GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a => generated 1688 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:35.282879 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-d268d7ac-b6c0-48e6-9ae7-e732955569cf tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:35.283526 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-d268d7ac-b6c0-48e6-9ae7-e732955569cf tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: 7aa85144-0ebe-430c-b9e5-9b656ea4560a] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:35.290390 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-d268d7ac-b6c0-48e6-9ae7-e732955569cf tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:35.291065 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-d268d7ac-b6c0-48e6-9ae7-e732955569cf tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:35.292148 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-d268d7ac-b6c0-48e6-9ae7-e732955569cf tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:35.292582 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-d268d7ac-b6c0-48e6-9ae7-e732955569cf tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:35.362045 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-23cc7867-4025-4eba-8681-b72e7d92f3b2 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1561827557", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1054937962", "security_groups": [{"name": "tempest-secgroup-smoke-178378433"}], "block_device_mapping_v2": [{"uuid": "208a5ab8-4087-4ecb-8fc0-dc28ebd669ba", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "597bf63d-63f6-4d8e-ac74-b0e435929cf3"}]}} {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:51:35.429915 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-d268d7ac-b6c0-48e6-9ae7-e732955569cf tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:35.438010 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-d268d7ac-b6c0-48e6-9ae7-e732955569cf tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a" status: 200 len: 1688 microversion: 2.1 time: 0.158758 May 26 12:51:35.438670 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 289/581] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:51:35 2022] GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a => generated 1688 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:35.481310 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.network.neutron [None req-23cc7867-4025-4eba-8681-b72e7d92f3b2 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] validate_networks() for [('597bf63d-63f6-4d8e-ac74-b0e435929cf3', None, None, None, None, None)] {{(pid=124823) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 12:51:35.843833 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.virt.hardware [None req-23cc7867-4025-4eba-8681-b72e7d92f3b2 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Flavor limits 0:0:0 {{(pid=124823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 12:51:35.844258 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.virt.hardware [None req-23cc7867-4025-4eba-8681-b72e7d92f3b2 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Image limits 0:0:0 {{(pid=124823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 12:51:35.844735 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.virt.hardware [None req-23cc7867-4025-4eba-8681-b72e7d92f3b2 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Flavor pref 0:0:0 {{(pid=124823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 12:51:35.845148 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.virt.hardware [None req-23cc7867-4025-4eba-8681-b72e7d92f3b2 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Image pref 0:0:0 {{(pid=124823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 12:51:35.845556 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.virt.hardware [None req-23cc7867-4025-4eba-8681-b72e7d92f3b2 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 12:51:35.854631 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-23cc7867-4025-4eba-8681-b72e7d92f3b2 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:35.855079 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-23cc7867-4025-4eba-8681-b72e7d92f3b2 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:35.855954 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-23cc7867-4025-4eba-8681-b72e7d92f3b2 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:35.856399 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-23cc7867-4025-4eba-8681-b72e7d92f3b2 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:35.874061 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.quota [None req-23cc7867-4025-4eba-8681-b72e7d92f3b2 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Getting quotas for project 23568023763549669484e71430e34389. Resources: {'instances', 'ram', 'cores'} {{(pid=124823) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:51:35.878180 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.quota [None req-23cc7867-4025-4eba-8681-b72e7d92f3b2 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Getting quotas for user b47d51863b0448b880dc03b01dec6dc5 and project 23568023763549669484e71430e34389. Resources: {'instances', 'ram', 'cores'} {{(pid=124823) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:51:35.936289 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-23cc7867-4025-4eba-8681-b72e7d92f3b2 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Going to run 1 instances... {{(pid=124823) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 12:51:35.938382 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-23cc7867-4025-4eba-8681-b72e7d92f3b2 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] [instance: 2b1f3f01-d549-4e51-ae06-24500312482c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='208a5ab8-4087-4ecb-8fc0-dc28ebd669ba',volume_size=None,volume_type=None)] {{(pid=124823) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 12:51:36.455512 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-ba30a731-7a0c-4dad-956a-34430700a775 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:36.460346 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-ba30a731-7a0c-4dad-956a-34430700a775 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: 7aa85144-0ebe-430c-b9e5-9b656ea4560a] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:36.462763 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-ba30a731-7a0c-4dad-956a-34430700a775 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:36.463208 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-ba30a731-7a0c-4dad-956a-34430700a775 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:36.464025 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-ba30a731-7a0c-4dad-956a-34430700a775 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:36.464456 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-ba30a731-7a0c-4dad-956a-34430700a775 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:36.551036 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-23cc7867-4025-4eba-8681-b72e7d92f3b2 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.192909 May 26 12:51:36.556667 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 293/582] 10.222.0.41 () {60 vars in 1146 bytes} [Thu May 26 12:51:35 2022] POST /compute/v2.1/servers => generated 405 bytes in 1195 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 12:51:36.562419 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-b82d3b33-5740-434e-9f07-06ece7096412 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:36.563031 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-b82d3b33-5740-434e-9f07-06ece7096412 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] [instance: 2b1f3f01-d549-4e51-ae06-24500312482c] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:36.621339 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-ba30a731-7a0c-4dad-956a-34430700a775 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:36.623271 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-b82d3b33-5740-434e-9f07-06ece7096412 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47d51863b0448b880dc03b01dec6dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23568023763549669484e71430e34389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:36.629570 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-ba30a731-7a0c-4dad-956a-34430700a775 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a" status: 200 len: 1688 microversion: 2.1 time: 0.178408 May 26 12:51:36.629842 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-b82d3b33-5740-434e-9f07-06ece7096412 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] 10.222.0.41 "GET /compute/v2.1/servers/2b1f3f01-d549-4e51-ae06-24500312482c" status: 200 len: 1095 microversion: 2.1 time: 0.071980 May 26 12:51:36.630197 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 290/583] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:51:36 2022] GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a => generated 1688 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:36.634027 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 294/584] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:51:36 2022] GET /compute/v2.1/servers/2b1f3f01-d549-4e51-ae06-24500312482c => generated 1095 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:51:37.647067 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-e0608902-cb0b-4fc9-9be5-ea15d4c279b4 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:37.647769 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-e0608902-cb0b-4fc9-9be5-ea15d4c279b4 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: 7aa85144-0ebe-430c-b9e5-9b656ea4560a] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:37.651012 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-0920e285-b042-47e3-a747-808c506f9044 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:37.652708 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-0920e285-b042-47e3-a747-808c506f9044 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] [instance: 2b1f3f01-d549-4e51-ae06-24500312482c] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:37.659319 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-e0608902-cb0b-4fc9-9be5-ea15d4c279b4 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:37.659912 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-e0608902-cb0b-4fc9-9be5-ea15d4c279b4 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:37.660695 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-e0608902-cb0b-4fc9-9be5-ea15d4c279b4 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:37.661128 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-e0608902-cb0b-4fc9-9be5-ea15d4c279b4 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:37.715032 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-0920e285-b042-47e3-a747-808c506f9044 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47d51863b0448b880dc03b01dec6dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23568023763549669484e71430e34389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:37.722071 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-0920e285-b042-47e3-a747-808c506f9044 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] 10.222.0.41 "GET /compute/v2.1/servers/2b1f3f01-d549-4e51-ae06-24500312482c" status: 200 len: 1095 microversion: 2.1 time: 0.075202 May 26 12:51:37.722918 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 295/585] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:51:37 2022] GET /compute/v2.1/servers/2b1f3f01-d549-4e51-ae06-24500312482c => generated 1095 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:51:37.798748 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-e0608902-cb0b-4fc9-9be5-ea15d4c279b4 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:37.806118 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-e0608902-cb0b-4fc9-9be5-ea15d4c279b4 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a" status: 200 len: 1688 microversion: 2.1 time: 0.163159 May 26 12:51:37.806687 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 291/586] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:51:37 2022] GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a => generated 1688 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:38.739284 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-4c2b01eb-e6e5-473e-8300-a8222f203147 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:38.739940 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-4c2b01eb-e6e5-473e-8300-a8222f203147 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] [instance: 2b1f3f01-d549-4e51-ae06-24500312482c] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:38.747436 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-4c2b01eb-e6e5-473e-8300-a8222f203147 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:38.748071 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-4c2b01eb-e6e5-473e-8300-a8222f203147 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:38.748737 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-4c2b01eb-e6e5-473e-8300-a8222f203147 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:38.749166 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-4c2b01eb-e6e5-473e-8300-a8222f203147 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:38.815055 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-4c2b01eb-e6e5-473e-8300-a8222f203147 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47d51863b0448b880dc03b01dec6dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23568023763549669484e71430e34389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:38.823161 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-a17496b8-5c9a-4e9e-a516-46541d0bc3d2 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:38.842384 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-a17496b8-5c9a-4e9e-a516-46541d0bc3d2 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: 7aa85144-0ebe-430c-b9e5-9b656ea4560a] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:38.842484 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-4c2b01eb-e6e5-473e-8300-a8222f203147 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] 10.222.0.41 "GET /compute/v2.1/servers/2b1f3f01-d549-4e51-ae06-24500312482c" status: 200 len: 1193 microversion: 2.1 time: 0.089072 May 26 12:51:38.842484 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 296/587] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:51:38 2022] GET /compute/v2.1/servers/2b1f3f01-d549-4e51-ae06-24500312482c => generated 1193 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:38.842681 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-a17496b8-5c9a-4e9e-a516-46541d0bc3d2 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:38.842681 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-a17496b8-5c9a-4e9e-a516-46541d0bc3d2 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:38.842681 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-a17496b8-5c9a-4e9e-a516-46541d0bc3d2 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:38.842681 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-a17496b8-5c9a-4e9e-a516-46541d0bc3d2 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:38.921398 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-a17496b8-5c9a-4e9e-a516-46541d0bc3d2 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:38.932983 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-a17496b8-5c9a-4e9e-a516-46541d0bc3d2 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a" status: 200 len: 1621 microversion: 2.1 time: 0.113538 May 26 12:51:38.938093 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 292/588] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:51:38 2022] GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a => generated 1621 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:38.975199 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [req-c12a3946-e40a-4756-82f6-d9075c0cb796 req-7c430be9-041d-405a-a944-8c9951890bb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7aa85144-0ebe-430c-b9e5-9b656ea4560a", "name": "network-vif-deleted", "tag": "e5a6930c-e135-4546-bcdc-823bfe4c6e87"}]} {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:51:38.983721 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [req-c12a3946-e40a-4756-82f6-d9075c0cb796 req-7c430be9-041d-405a-a944-8c9951890bb1 service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:38.984366 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [req-c12a3946-e40a-4756-82f6-d9075c0cb796 req-7c430be9-041d-405a-a944-8c9951890bb1 service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:38.996143 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.compute.server_external_events [req-c12a3946-e40a-4756-82f6-d9075c0cb796 req-7c430be9-041d-405a-a944-8c9951890bb1 service nova] Creating event network-vif-deleted:e5a6930c-e135-4546-bcdc-823bfe4c6e87 for instance 7aa85144-0ebe-430c-b9e5-9b656ea4560a on hv-cinder-81571 May 26 12:51:39.002003 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [req-c12a3946-e40a-4756-82f6-d9075c0cb796 req-7c430be9-041d-405a-a944-8c9951890bb1 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143934 May 26 12:51:39.002619 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 297/589] 10.222.0.41 () {64 vars in 1317 bytes} [Thu May 26 12:51:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:51:39.842397 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-320556e2-c722-48f0-a6d6-96ab0ef3e3d7 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:39.844623 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-320556e2-c722-48f0-a6d6-96ab0ef3e3d7 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] [instance: 2b1f3f01-d549-4e51-ae06-24500312482c] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:39.851765 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-320556e2-c722-48f0-a6d6-96ab0ef3e3d7 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:39.852412 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-320556e2-c722-48f0-a6d6-96ab0ef3e3d7 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:39.853499 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-320556e2-c722-48f0-a6d6-96ab0ef3e3d7 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:39.853972 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-320556e2-c722-48f0-a6d6-96ab0ef3e3d7 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:39.935600 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-320556e2-c722-48f0-a6d6-96ab0ef3e3d7 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47d51863b0448b880dc03b01dec6dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23568023763549669484e71430e34389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:39.946716 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-320556e2-c722-48f0-a6d6-96ab0ef3e3d7 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] 10.222.0.41 "GET /compute/v2.1/servers/2b1f3f01-d549-4e51-ae06-24500312482c" status: 200 len: 1211 microversion: 2.1 time: 0.108087 May 26 12:51:39.949296 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 293/590] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:51:39 2022] GET /compute/v2.1/servers/2b1f3f01-d549-4e51-ae06-24500312482c => generated 1211 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:39.966017 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-be730f24-61f5-4fdd-acde-0831f89651d0 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:39.967279 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-be730f24-61f5-4fdd-acde-0831f89651d0 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: 7aa85144-0ebe-430c-b9e5-9b656ea4560a] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:39.974445 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-be730f24-61f5-4fdd-acde-0831f89651d0 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:39.975155 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-be730f24-61f5-4fdd-acde-0831f89651d0 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:39.976102 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-be730f24-61f5-4fdd-acde-0831f89651d0 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:39.976530 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-be730f24-61f5-4fdd-acde-0831f89651d0 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:40.009630 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-be730f24-61f5-4fdd-acde-0831f89651d0 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:40.010098 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-be730f24-61f5-4fdd-acde-0831f89651d0 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:40.011066 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.objects.instance [None req-be730f24-61f5-4fdd-acde-0831f89651d0 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lazy-loading 'fault' on Instance uuid 7aa85144-0ebe-430c-b9e5-9b656ea4560a {{(pid=124823) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:51:40.052416 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-be730f24-61f5-4fdd-acde-0831f89651d0 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:40.075869 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-be730f24-61f5-4fdd-acde-0831f89651d0 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a" status: 200 len: 1335 microversion: 2.1 time: 0.110668 May 26 12:51:40.075869 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 298/591] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:51:39 2022] GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a => generated 1335 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:40.971031 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-4283a3bc-ceea-4b2d-90e4-50e54aec13d1 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:40.971642 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-4283a3bc-ceea-4b2d-90e4-50e54aec13d1 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] [instance: 2b1f3f01-d549-4e51-ae06-24500312482c] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:40.978157 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-4283a3bc-ceea-4b2d-90e4-50e54aec13d1 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:40.980254 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-4283a3bc-ceea-4b2d-90e4-50e54aec13d1 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:40.980254 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-4283a3bc-ceea-4b2d-90e4-50e54aec13d1 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:40.980475 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-4283a3bc-ceea-4b2d-90e4-50e54aec13d1 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:41.077415 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-f4fc4f55-61bf-4902-82cd-ee10a7406d83 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:41.078937 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-f4fc4f55-61bf-4902-82cd-ee10a7406d83 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: 7aa85144-0ebe-430c-b9e5-9b656ea4560a] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:41.088021 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-f4fc4f55-61bf-4902-82cd-ee10a7406d83 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:41.089826 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-f4fc4f55-61bf-4902-82cd-ee10a7406d83 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:41.091205 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-f4fc4f55-61bf-4902-82cd-ee10a7406d83 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:41.091925 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-f4fc4f55-61bf-4902-82cd-ee10a7406d83 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:41.114309 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.wsgi [None req-f4fc4f55-61bf-4902-82cd-ee10a7406d83 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] HTTP exception thrown: Instance 7aa85144-0ebe-430c-b9e5-9b656ea4560a could not be found. May 26 12:51:41.116317 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-f4fc4f55-61bf-4902-82cd-ee10a7406d83 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Request method failure captured: May 26 12:51:41.116317 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: request: GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a HTTP/1.1 May 26 12:51:41.116317 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Accept: application/json May 26 12:51:41.116317 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Accept-Encoding: identity May 26 12:51:41.116317 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Connection: close May 26 12:51:41.116317 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Content-Length: 0 May 26 12:51:41.116317 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Content-Type: application/json May 26 12:51:41.116317 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Host: 10.222.0.41 May 26 12:51:41.116317 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Openstack-System-Scope: None May 26 12:51:41.116317 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: User-Agent: python-urllib3/1.26.9 May 26 12:51:41.116317 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Auth-Token: gAAAAABij3aX6bwsviEkeUYewj-xlndiK1bsPBf92DMS42pl4gfoAWpT2Nwqjxg-XMZou9-CFzmPCmtZ9TjM3zfCdG4bAle_MvCdrJrquNKcFpkWDFLqcD6Kq3oa26r5AlaY0DKFiwUUVBB5lqaRpwXOXIz3ew4L1IUMZ8-eR1xMR1hG_1d6fpk May 26 12:51:41.116317 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Domain-Id: None May 26 12:51:41.116317 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Domain-Name: None May 26 12:51:41.116317 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Identity-Status: Confirmed May 26 12:51:41.116317 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Is-Admin-Project: True May 26 12:51:41.116317 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Project-Domain-Id: default May 26 12:51:41.116317 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Project-Domain-Name: Default May 26 12:51:41.116317 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Project-Id: 9930a0f4448d4ef0a6030da17a36257a May 26 12:51:41.116317 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1873359870 May 26 12:51:41.116317 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Role: member,reader May 26 12:51:41.116317 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Roles: member,reader May 26 12:51:41.123831 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/9930a0f4448d4ef0a6030da17a36257a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/9930a0f4448d4ef0a6030da17a36257a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/9930a0f4448d4ef0a6030da17a36257a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_9930a0f4448d4ef0a6030da17a36257a", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 26 12:51:41.123831 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1873359870 May 26 12:51:41.123831 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Tenant-Id: 9930a0f4448d4ef0a6030da17a36257a May 26 12:51:41.123831 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1873359870 May 26 12:51:41.123831 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User: tempest-ServerRescueNegativeTestJSON-1873359870-project May 26 12:51:41.123831 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User-Domain-Id: default May 26 12:51:41.123831 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User-Domain-Name: Default May 26 12:51:41.123831 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User-Id: cf98a4d33cab49b08640f437dbfb2dc8 May 26 12:51:41.123831 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1873359870-project May 26 12:51:41.123831 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: method: > May 26 12:51:41.123831 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: exception: Instance 7aa85144-0ebe-430c-b9e5-9b656ea4560a could not be found. May 26 12:51:41.123831 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: action_args: {'id': '7aa85144-0ebe-430c-b9e5-9b656ea4560a'} May 26 12:51:41.124891 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:51:41.124891 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:51:41.124891 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:51:41.124891 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:51:41.124891 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:51:41.124891 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:51:41.124891 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:51:41.124891 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:51:41.124891 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:51:41.124891 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:51:41.124891 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7aa85144-0ebe-430c-b9e5-9b656ea4560a could not be found. May 26 12:51:41.124891 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:51:41.124891 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:51:41.124891 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:51:41.124891 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:51:41.124891 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:51:41.124891 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:51:41.124891 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:51:41.124891 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:51:41.124891 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:51:41.126426 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:51:41.126426 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 12:51:41.126426 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 12:51:41.126426 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:51:41.126426 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:51:41.126426 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:51:41.126426 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:51:41.126426 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7aa85144-0ebe-430c-b9e5-9b656ea4560a could not be found. May 26 12:51:41.126426 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:51:41.126426 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:51:41.126426 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:51:41.126426 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:51:41.126426 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:51:41.126426 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:51:41.126426 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:51:41.126426 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:51:41.126426 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7aa85144-0ebe-430c-b9e5-9b656ea4560a could not be found. May 26 12:51:41.126426 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:51:41.127707 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-f4fc4f55-61bf-4902-82cd-ee10a7406d83 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Returning 404 to user: Instance 7aa85144-0ebe-430c-b9e5-9b656ea4560a could not be found. {{(pid=124823) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:51:41.127707 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-f4fc4f55-61bf-4902-82cd-ee10a7406d83 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a" status: 404 len: 111 microversion: 2.1 time: 0.046203 May 26 12:51:41.127707 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 299/592] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:51:41 2022] GET /compute/v2.1/servers/7aa85144-0ebe-430c-b9e5-9b656ea4560a => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 12:51:41.139523 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-877d4b0a-9f6e-42c7-a2ca-3035ec0dd2a9 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '.version_select at 0x7f26a1eca790>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:41.236091 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-4283a3bc-ceea-4b2d-90e4-50e54aec13d1 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47d51863b0448b880dc03b01dec6dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23568023763549669484e71430e34389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:41.245195 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-4283a3bc-ceea-4b2d-90e4-50e54aec13d1 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] 10.222.0.41 "GET /compute/v2.1/servers/2b1f3f01-d549-4e51-ae06-24500312482c" status: 200 len: 1278 microversion: 2.1 time: 0.277601 May 26 12:51:41.246367 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 294/593] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:51:40 2022] GET /compute/v2.1/servers/2b1f3f01-d549-4e51-ae06-24500312482c => generated 1278 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:41.411093 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-877d4b0a-9f6e-42c7-a2ca-3035ec0dd2a9 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1042284356" status: 202 len: 0 microversion: 2.1 time: 0.278284 May 26 12:51:41.413280 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 300/594] 10.222.0.41 () {58 vars in 1220 bytes} [Thu May 26 12:51:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1042284356 => generated 0 bytes in 280 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 12:51:41.529616 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [req-f93a8c91-e98d-4b8c-b916-85293b55ea16 req-c52f6668-9372-45ba-bcef-ed78f97996fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b1f3f01-d549-4e51-ae06-24500312482c", "tag": "b5cef465-47cf-457a-a033-c7366a071c70"}]} {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:51:41.544328 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [req-f93a8c91-e98d-4b8c-b916-85293b55ea16 req-c52f6668-9372-45ba-bcef-ed78f97996fe service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:41.549064 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [req-f93a8c91-e98d-4b8c-b916-85293b55ea16 req-c52f6668-9372-45ba-bcef-ed78f97996fe service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:41.582960 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.compute.server_external_events [req-f93a8c91-e98d-4b8c-b916-85293b55ea16 req-c52f6668-9372-45ba-bcef-ed78f97996fe service nova] Creating event network-changed:b5cef465-47cf-457a-a033-c7366a071c70 for instance 2b1f3f01-d549-4e51-ae06-24500312482c on hv-cinder-81571 May 26 12:51:41.588179 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [req-f93a8c91-e98d-4b8c-b916-85293b55ea16 req-c52f6668-9372-45ba-bcef-ed78f97996fe service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064281 May 26 12:51:41.589725 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 295/595] 10.222.0.41 () {64 vars in 1317 bytes} [Thu May 26 12:51:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:51:42.264165 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-54e91ca5-bad0-41b0-b7e7-d7b4048be1d0 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:42.264779 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-54e91ca5-bad0-41b0-b7e7-d7b4048be1d0 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] [instance: 2b1f3f01-d549-4e51-ae06-24500312482c] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:42.272267 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-54e91ca5-bad0-41b0-b7e7-d7b4048be1d0 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:42.272664 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-54e91ca5-bad0-41b0-b7e7-d7b4048be1d0 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:42.273445 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-54e91ca5-bad0-41b0-b7e7-d7b4048be1d0 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:42.273992 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-54e91ca5-bad0-41b0-b7e7-d7b4048be1d0 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:42.411301 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-54e91ca5-bad0-41b0-b7e7-d7b4048be1d0 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47d51863b0448b880dc03b01dec6dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23568023763549669484e71430e34389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:42.419490 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-54e91ca5-bad0-41b0-b7e7-d7b4048be1d0 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] 10.222.0.41 "GET /compute/v2.1/servers/2b1f3f01-d549-4e51-ae06-24500312482c" status: 200 len: 1266 microversion: 2.1 time: 0.160235 May 26 12:51:42.420074 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 301/596] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:51:42 2022] GET /compute/v2.1/servers/2b1f3f01-d549-4e51-ae06-24500312482c => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:42.710864 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-cceb0dc3-f64a-43dd-9750-e522b6380ce4 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:42.711549 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-cceb0dc3-f64a-43dd-9750-e522b6380ce4 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: 1b2f404c-1ca9-4904-944c-16685c8f68c5] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:42.718522 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-cceb0dc3-f64a-43dd-9750-e522b6380ce4 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:42.719045 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-cceb0dc3-f64a-43dd-9750-e522b6380ce4 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:42.719822 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-cceb0dc3-f64a-43dd-9750-e522b6380ce4 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:42.720260 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-cceb0dc3-f64a-43dd-9750-e522b6380ce4 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:42.745231 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-cceb0dc3-f64a-43dd-9750-e522b6380ce4 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "GET /compute/v2.1/servers/1b2f404c-1ca9-4904-944c-16685c8f68c5/ips" status: 200 len: 149 microversion: 2.1 time: 0.267339 May 26 12:51:42.745856 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 296/597] 10.222.0.41 () {58 vars in 1247 bytes} [Thu May 26 12:51:42 2022] GET /compute/v2.1/servers/1b2f404c-1ca9-4904-944c-16685c8f68c5/ips => generated 149 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:51:43.442838 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-7eff3ca0-a209-4493-b58d-2673b998e37e tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:43.442838 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-7eff3ca0-a209-4493-b58d-2673b998e37e tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] [instance: 2b1f3f01-d549-4e51-ae06-24500312482c] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:43.445493 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-7eff3ca0-a209-4493-b58d-2673b998e37e tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:43.445987 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-7eff3ca0-a209-4493-b58d-2673b998e37e tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:43.446760 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-7eff3ca0-a209-4493-b58d-2673b998e37e tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:43.447192 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-7eff3ca0-a209-4493-b58d-2673b998e37e tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:43.582404 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-7eff3ca0-a209-4493-b58d-2673b998e37e tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47d51863b0448b880dc03b01dec6dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23568023763549669484e71430e34389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:43.590989 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-7eff3ca0-a209-4493-b58d-2673b998e37e tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] 10.222.0.41 "GET /compute/v2.1/servers/2b1f3f01-d549-4e51-ae06-24500312482c" status: 200 len: 1266 microversion: 2.1 time: 0.156678 May 26 12:51:43.591498 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 302/598] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:51:43 2022] GET /compute/v2.1/servers/2b1f3f01-d549-4e51-ae06-24500312482c => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:44.448230 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-7b1c68cc-ae58-4636-91e4-32b60694302b tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "079573b3-90ce-43da-a220-af08c0c7c482"}} {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:51:44.449987 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-7b1c68cc-ae58-4636-91e4-32b60694302b tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: 1b2f404c-1ca9-4904-944c-16685c8f68c5] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:44.456581 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-7b1c68cc-ae58-4636-91e4-32b60694302b tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:44.457029 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-7b1c68cc-ae58-4636-91e4-32b60694302b tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:44.457837 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-7b1c68cc-ae58-4636-91e4-32b60694302b tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:44.458505 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-7b1c68cc-ae58-4636-91e4-32b60694302b tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:44.607338 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-875d53d6-6571-47d3-a048-a975c062e8e5 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:44.607957 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-875d53d6-6571-47d3-a048-a975c062e8e5 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] [instance: 2b1f3f01-d549-4e51-ae06-24500312482c] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:44.614535 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-875d53d6-6571-47d3-a048-a975c062e8e5 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:44.614990 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-875d53d6-6571-47d3-a048-a975c062e8e5 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:44.615754 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-875d53d6-6571-47d3-a048-a975c062e8e5 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:44.616189 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-875d53d6-6571-47d3-a048-a975c062e8e5 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:44.750837 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-875d53d6-6571-47d3-a048-a975c062e8e5 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47d51863b0448b880dc03b01dec6dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23568023763549669484e71430e34389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:44.758552 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-875d53d6-6571-47d3-a048-a975c062e8e5 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] 10.222.0.41 "GET /compute/v2.1/servers/2b1f3f01-d549-4e51-ae06-24500312482c" status: 200 len: 1266 microversion: 2.1 time: 0.155100 May 26 12:51:44.760742 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 303/599] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:51:44 2022] GET /compute/v2.1/servers/2b1f3f01-d549-4e51-ae06-24500312482c => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:51:44.845009 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-a71590b2-ec5f-4465-aedf-109725aa2a34 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:44.848439 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-a71590b2-ec5f-4465-aedf-109725aa2a34 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: a442ae3a-5311-4f8f-acf3-08ce1534c9ea] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:44.851770 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-a71590b2-ec5f-4465-aedf-109725aa2a34 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:44.852223 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-a71590b2-ec5f-4465-aedf-109725aa2a34 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:44.852985 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-a71590b2-ec5f-4465-aedf-109725aa2a34 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:44.853420 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-a71590b2-ec5f-4465-aedf-109725aa2a34 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:44.878709 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-a71590b2-ec5f-4465-aedf-109725aa2a34 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: a442ae3a-5311-4f8f-acf3-08ce1534c9ea] Going to try to terminate instance {{(pid=124823) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 12:51:45.228921 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-a71590b2-ec5f-4465-aedf-109725aa2a34 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "DELETE /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea" status: 204 len: 0 microversion: 2.1 time: 0.387468 May 26 12:51:45.229513 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 304/600] 10.222.0.41 () {58 vars in 1238 bytes} [Thu May 26 12:51:44 2022] DELETE /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea => generated 0 bytes in 389 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 26 12:51:45.237974 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-8796e966-e19b-48aa-874b-5635f27209ba tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:45.238673 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-8796e966-e19b-48aa-874b-5635f27209ba tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: a442ae3a-5311-4f8f-acf3-08ce1534c9ea] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:45.244768 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-8796e966-e19b-48aa-874b-5635f27209ba tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:45.245221 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-8796e966-e19b-48aa-874b-5635f27209ba tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:45.246506 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-8796e966-e19b-48aa-874b-5635f27209ba tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:45.246939 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-8796e966-e19b-48aa-874b-5635f27209ba tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:45.384244 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-8796e966-e19b-48aa-874b-5635f27209ba tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:45.388373 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG dbcounter [-] [124823] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:51:45.392650 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-8796e966-e19b-48aa-874b-5635f27209ba tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea" status: 200 len: 1506 microversion: 2.1 time: 0.158796 May 26 12:51:45.393218 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 305/601] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:51:45 2022] GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea => generated 1506 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:51:45.471605 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-7b1c68cc-ae58-4636-91e4-32b60694302b tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "POST /compute/v2.1/servers/1b2f404c-1ca9-4904-944c-16685c8f68c5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.027148 May 26 12:51:45.472582 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 297/602] 10.222.0.41 () {60 vars in 1322 bytes} [Thu May 26 12:51:44 2022] POST /compute/v2.1/servers/1b2f404c-1ca9-4904-944c-16685c8f68c5/os-volume_attachments => generated 194 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:51:45.775816 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-b7442cc7-2ab4-456d-8f8b-52be85c7923b tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:45.776460 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-b7442cc7-2ab4-456d-8f8b-52be85c7923b tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] [instance: 2b1f3f01-d549-4e51-ae06-24500312482c] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:45.783731 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-b7442cc7-2ab4-456d-8f8b-52be85c7923b tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:45.784272 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-b7442cc7-2ab4-456d-8f8b-52be85c7923b tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:45.785030 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-b7442cc7-2ab4-456d-8f8b-52be85c7923b tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:45.785462 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-b7442cc7-2ab4-456d-8f8b-52be85c7923b tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:45.867357 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG dbcounter [-] [124823] Writing DB stats nova_cell0:SELECT=2 {{(pid=124823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:51:45.917911 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-b7442cc7-2ab4-456d-8f8b-52be85c7923b tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47d51863b0448b880dc03b01dec6dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23568023763549669484e71430e34389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:45.925273 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-b7442cc7-2ab4-456d-8f8b-52be85c7923b tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] 10.222.0.41 "GET /compute/v2.1/servers/2b1f3f01-d549-4e51-ae06-24500312482c" status: 200 len: 1266 microversion: 2.1 time: 0.153743 May 26 12:51:45.925857 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 306/603] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:51:45 2022] GET /compute/v2.1/servers/2b1f3f01-d549-4e51-ae06-24500312482c => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:46.410268 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-053a5b03-5576-4fe3-8483-a6e308a46a50 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:46.410969 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-053a5b03-5576-4fe3-8483-a6e308a46a50 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: a442ae3a-5311-4f8f-acf3-08ce1534c9ea] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:46.417173 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-053a5b03-5576-4fe3-8483-a6e308a46a50 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:46.418176 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-053a5b03-5576-4fe3-8483-a6e308a46a50 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:46.419110 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-053a5b03-5576-4fe3-8483-a6e308a46a50 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:46.419547 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-053a5b03-5576-4fe3-8483-a6e308a46a50 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:46.439028 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG dbcounter [-] [124824] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:51:46.555080 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-053a5b03-5576-4fe3-8483-a6e308a46a50 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:46.563654 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-053a5b03-5576-4fe3-8483-a6e308a46a50 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea" status: 200 len: 1506 microversion: 2.1 time: 0.158081 May 26 12:51:46.564230 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 298/604] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:51:46 2022] GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea => generated 1506 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:46.942461 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-b4261454-0317-48e2-9301-8d22652928f6 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:46.943101 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-b4261454-0317-48e2-9301-8d22652928f6 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] [instance: 2b1f3f01-d549-4e51-ae06-24500312482c] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:46.950060 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-b4261454-0317-48e2-9301-8d22652928f6 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:46.950537 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-b4261454-0317-48e2-9301-8d22652928f6 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:46.951287 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-b4261454-0317-48e2-9301-8d22652928f6 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:46.951716 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-b4261454-0317-48e2-9301-8d22652928f6 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:47.082835 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-b4261454-0317-48e2-9301-8d22652928f6 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47d51863b0448b880dc03b01dec6dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23568023763549669484e71430e34389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:47.091144 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-b4261454-0317-48e2-9301-8d22652928f6 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] 10.222.0.41 "GET /compute/v2.1/servers/2b1f3f01-d549-4e51-ae06-24500312482c" status: 200 len: 1266 microversion: 2.1 time: 0.152632 May 26 12:51:47.091709 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 307/605] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:51:46 2022] GET /compute/v2.1/servers/2b1f3f01-d549-4e51-ae06-24500312482c => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:47.581067 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-cabc488d-6890-42e4-96cd-b1d2d4847980 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:47.581584 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-cabc488d-6890-42e4-96cd-b1d2d4847980 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: a442ae3a-5311-4f8f-acf3-08ce1534c9ea] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:47.588594 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-cabc488d-6890-42e4-96cd-b1d2d4847980 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:47.589051 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-cabc488d-6890-42e4-96cd-b1d2d4847980 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:47.590423 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-cabc488d-6890-42e4-96cd-b1d2d4847980 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:47.590863 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-cabc488d-6890-42e4-96cd-b1d2d4847980 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:48.026385 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [req-e667e5a0-3329-437f-b951-d8671329e812 req-0e2861ce-8fd5-44de-bb5e-de9b814e4a7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a442ae3a-5311-4f8f-acf3-08ce1534c9ea", "name": "network-vif-deleted", "tag": "c5f9931f-3848-4a65-a86f-13a2bf480725"}]} {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:51:48.029873 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG dbcounter [-] [124823] Writing DB stats nova_cell0:SELECT=10 {{(pid=124823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:51:48.035143 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-cabc488d-6890-42e4-96cd-b1d2d4847980 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:48.035966 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [req-e667e5a0-3329-437f-b951-d8671329e812 req-0e2861ce-8fd5-44de-bb5e-de9b814e4a7c service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:48.036412 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [req-e667e5a0-3329-437f-b951-d8671329e812 req-0e2861ce-8fd5-44de-bb5e-de9b814e4a7c service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:48.047147 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-cabc488d-6890-42e4-96cd-b1d2d4847980 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea" status: 200 len: 1506 microversion: 2.1 time: 0.469876 May 26 12:51:48.049700 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 299/606] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:51:47 2022] GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea => generated 1506 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:48.049839 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.compute.server_external_events [req-e667e5a0-3329-437f-b951-d8671329e812 req-0e2861ce-8fd5-44de-bb5e-de9b814e4a7c service nova] Creating event network-vif-deleted:c5f9931f-3848-4a65-a86f-13a2bf480725 for instance a442ae3a-5311-4f8f-acf3-08ce1534c9ea on hv-cinder-81571 May 26 12:51:48.054676 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [req-e667e5a0-3329-437f-b951-d8671329e812 req-0e2861ce-8fd5-44de-bb5e-de9b814e4a7c service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032441 May 26 12:51:48.055259 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 308/607] 10.222.0.41 () {64 vars in 1317 bytes} [Thu May 26 12:51:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:51:48.108683 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-423946be-7d0d-4562-9bd5-27df8984bf95 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:48.109297 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-423946be-7d0d-4562-9bd5-27df8984bf95 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] [instance: 2b1f3f01-d549-4e51-ae06-24500312482c] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:48.115690 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-423946be-7d0d-4562-9bd5-27df8984bf95 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:48.116445 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-423946be-7d0d-4562-9bd5-27df8984bf95 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:48.116896 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-423946be-7d0d-4562-9bd5-27df8984bf95 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:48.117327 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-423946be-7d0d-4562-9bd5-27df8984bf95 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:48.259607 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-423946be-7d0d-4562-9bd5-27df8984bf95 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47d51863b0448b880dc03b01dec6dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23568023763549669484e71430e34389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:48.267218 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-423946be-7d0d-4562-9bd5-27df8984bf95 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] 10.222.0.41 "GET /compute/v2.1/servers/2b1f3f01-d549-4e51-ae06-24500312482c" status: 200 len: 1266 microversion: 2.1 time: 0.162982 May 26 12:51:48.267784 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 300/608] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:51:48 2022] GET /compute/v2.1/servers/2b1f3f01-d549-4e51-ae06-24500312482c => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:49.065734 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-199b4d22-6531-4ff5-aaf5-32253f705205 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:49.066436 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-199b4d22-6531-4ff5-aaf5-32253f705205 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: a442ae3a-5311-4f8f-acf3-08ce1534c9ea] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:49.073120 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-199b4d22-6531-4ff5-aaf5-32253f705205 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:49.073576 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-199b4d22-6531-4ff5-aaf5-32253f705205 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:49.074369 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-199b4d22-6531-4ff5-aaf5-32253f705205 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:49.074800 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-199b4d22-6531-4ff5-aaf5-32253f705205 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:49.106882 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-199b4d22-6531-4ff5-aaf5-32253f705205 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:49.107328 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-199b4d22-6531-4ff5-aaf5-32253f705205 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:49.107775 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.objects.instance [None req-199b4d22-6531-4ff5-aaf5-32253f705205 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lazy-loading 'fault' on Instance uuid a442ae3a-5311-4f8f-acf3-08ce1534c9ea {{(pid=124823) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:51:49.148841 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-199b4d22-6531-4ff5-aaf5-32253f705205 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:49.157497 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-199b4d22-6531-4ff5-aaf5-32253f705205 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea" status: 200 len: 1311 microversion: 2.1 time: 0.096384 May 26 12:51:49.158128 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 309/609] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:51:49 2022] GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea => generated 1311 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:49.284185 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-63345e42-4eca-4ca9-8b6b-5826883c59b8 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:49.284794 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-63345e42-4eca-4ca9-8b6b-5826883c59b8 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] [instance: 2b1f3f01-d549-4e51-ae06-24500312482c] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:49.291302 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-63345e42-4eca-4ca9-8b6b-5826883c59b8 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:49.291752 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-63345e42-4eca-4ca9-8b6b-5826883c59b8 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:49.293268 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-63345e42-4eca-4ca9-8b6b-5826883c59b8 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:49.293874 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-63345e42-4eca-4ca9-8b6b-5826883c59b8 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:49.430694 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-63345e42-4eca-4ca9-8b6b-5826883c59b8 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47d51863b0448b880dc03b01dec6dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23568023763549669484e71430e34389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:49.438721 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-63345e42-4eca-4ca9-8b6b-5826883c59b8 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] 10.222.0.41 "GET /compute/v2.1/servers/2b1f3f01-d549-4e51-ae06-24500312482c" status: 200 len: 1266 microversion: 2.1 time: 0.158455 May 26 12:51:49.439284 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 301/610] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:51:49 2022] GET /compute/v2.1/servers/2b1f3f01-d549-4e51-ae06-24500312482c => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:51:50.178952 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-a0974139-a9a8-4de9-b6a9-3c8c1752ea6b tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:50.178952 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-a0974139-a9a8-4de9-b6a9-3c8c1752ea6b tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: a442ae3a-5311-4f8f-acf3-08ce1534c9ea] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:50.183762 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-a0974139-a9a8-4de9-b6a9-3c8c1752ea6b tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:50.184203 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-a0974139-a9a8-4de9-b6a9-3c8c1752ea6b tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:50.185017 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-a0974139-a9a8-4de9-b6a9-3c8c1752ea6b tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:50.185445 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-a0974139-a9a8-4de9-b6a9-3c8c1752ea6b tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:50.198897 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.wsgi [None req-a0974139-a9a8-4de9-b6a9-3c8c1752ea6b tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] HTTP exception thrown: Instance a442ae3a-5311-4f8f-acf3-08ce1534c9ea could not be found. May 26 12:51:50.200572 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-a0974139-a9a8-4de9-b6a9-3c8c1752ea6b tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Request method failure captured: May 26 12:51:50.200572 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: request: GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea HTTP/1.1 May 26 12:51:50.200572 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Accept: application/json May 26 12:51:50.200572 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Accept-Encoding: identity May 26 12:51:50.200572 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Connection: close May 26 12:51:50.200572 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Content-Length: 0 May 26 12:51:50.200572 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Content-Type: application/json May 26 12:51:50.200572 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Host: 10.222.0.41 May 26 12:51:50.200572 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Openstack-System-Scope: None May 26 12:51:50.200572 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: User-Agent: python-urllib3/1.26.9 May 26 12:51:50.200572 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Auth-Token: gAAAAABij3aX6bwsviEkeUYewj-xlndiK1bsPBf92DMS42pl4gfoAWpT2Nwqjxg-XMZou9-CFzmPCmtZ9TjM3zfCdG4bAle_MvCdrJrquNKcFpkWDFLqcD6Kq3oa26r5AlaY0DKFiwUUVBB5lqaRpwXOXIz3ew4L1IUMZ8-eR1xMR1hG_1d6fpk May 26 12:51:50.200572 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Domain-Id: None May 26 12:51:50.200572 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Domain-Name: None May 26 12:51:50.200572 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Identity-Status: Confirmed May 26 12:51:50.200572 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Is-Admin-Project: True May 26 12:51:50.200572 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Project-Domain-Id: default May 26 12:51:50.200572 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Project-Domain-Name: Default May 26 12:51:50.200572 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Project-Id: 9930a0f4448d4ef0a6030da17a36257a May 26 12:51:50.200572 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1873359870 May 26 12:51:50.200572 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Role: member,reader May 26 12:51:50.200572 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Roles: member,reader May 26 12:51:50.207132 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/9930a0f4448d4ef0a6030da17a36257a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/9930a0f4448d4ef0a6030da17a36257a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/9930a0f4448d4ef0a6030da17a36257a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_9930a0f4448d4ef0a6030da17a36257a", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 26 12:51:50.207132 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1873359870 May 26 12:51:50.207132 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Tenant-Id: 9930a0f4448d4ef0a6030da17a36257a May 26 12:51:50.207132 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1873359870 May 26 12:51:50.207132 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User: tempest-ServerRescueNegativeTestJSON-1873359870-project May 26 12:51:50.207132 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User-Domain-Id: default May 26 12:51:50.207132 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User-Domain-Name: Default May 26 12:51:50.207132 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User-Id: cf98a4d33cab49b08640f437dbfb2dc8 May 26 12:51:50.207132 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1873359870-project May 26 12:51:50.207132 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: method: > May 26 12:51:50.207132 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: exception: Instance a442ae3a-5311-4f8f-acf3-08ce1534c9ea could not be found. May 26 12:51:50.207132 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: action_args: {'id': 'a442ae3a-5311-4f8f-acf3-08ce1534c9ea'} May 26 12:51:50.207971 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:51:50.207971 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:51:50.207971 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:51:50.207971 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:51:50.207971 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:51:50.207971 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:51:50.207971 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:51:50.207971 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:51:50.207971 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:51:50.207971 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:51:50.207971 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a442ae3a-5311-4f8f-acf3-08ce1534c9ea could not be found. May 26 12:51:50.207971 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:51:50.207971 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:51:50.207971 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:51:50.207971 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:51:50.207971 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:51:50.207971 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:51:50.207971 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:51:50.207971 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:51:50.207971 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:51:50.209252 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:51:50.209252 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 12:51:50.209252 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 12:51:50.209252 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:51:50.209252 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:51:50.209252 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:51:50.209252 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:51:50.209252 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a442ae3a-5311-4f8f-acf3-08ce1534c9ea could not be found. May 26 12:51:50.209252 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:51:50.209252 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:51:50.209252 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:51:50.209252 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:51:50.209252 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:51:50.209252 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:51:50.209252 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:51:50.209252 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:51:50.209252 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a442ae3a-5311-4f8f-acf3-08ce1534c9ea could not be found. May 26 12:51:50.209252 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:51:50.210590 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-a0974139-a9a8-4de9-b6a9-3c8c1752ea6b tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Returning 404 to user: Instance a442ae3a-5311-4f8f-acf3-08ce1534c9ea could not be found. {{(pid=124823) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:51:50.210590 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-a0974139-a9a8-4de9-b6a9-3c8c1752ea6b tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea" status: 404 len: 111 microversion: 2.1 time: 0.029456 May 26 12:51:50.210590 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 310/611] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:51:50 2022] GET /compute/v2.1/servers/a442ae3a-5311-4f8f-acf3-08ce1534c9ea => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:51:50.215263 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-553cefe3-582a-4ed6-9ed4-361aa856ed2f tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:50.215761 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-553cefe3-582a-4ed6-9ed4-361aa856ed2f tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:50.221828 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-553cefe3-582a-4ed6-9ed4-361aa856ed2f tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:50.222526 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-553cefe3-582a-4ed6-9ed4-361aa856ed2f tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:50.223468 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-553cefe3-582a-4ed6-9ed4-361aa856ed2f tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:50.223899 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-553cefe3-582a-4ed6-9ed4-361aa856ed2f tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:50.250723 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-553cefe3-582a-4ed6-9ed4-361aa856ed2f tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a] Going to try to terminate instance {{(pid=124824) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 12:51:50.456226 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-e3eede15-f07a-465e-94bd-bf45dc7549d7 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:50.456760 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-e3eede15-f07a-465e-94bd-bf45dc7549d7 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] [instance: 2b1f3f01-d549-4e51-ae06-24500312482c] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:50.462796 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-e3eede15-f07a-465e-94bd-bf45dc7549d7 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:50.463248 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-e3eede15-f07a-465e-94bd-bf45dc7549d7 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:50.464044 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-e3eede15-f07a-465e-94bd-bf45dc7549d7 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:50.465042 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-e3eede15-f07a-465e-94bd-bf45dc7549d7 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:50.548019 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-553cefe3-582a-4ed6-9ed4-361aa856ed2f tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "DELETE /compute/v2.1/servers/c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a" status: 204 len: 0 microversion: 2.1 time: 0.340979 May 26 12:51:50.548689 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 302/612] 10.222.0.41 () {58 vars in 1238 bytes} [Thu May 26 12:51:50 2022] DELETE /compute/v2.1/servers/c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 12:51:50.556915 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-111a4650-e662-41df-858c-b999261ddc4e tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:50.557735 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-111a4650-e662-41df-858c-b999261ddc4e tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:50.563782 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-111a4650-e662-41df-858c-b999261ddc4e tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:50.564230 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-111a4650-e662-41df-858c-b999261ddc4e tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:50.564999 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-111a4650-e662-41df-858c-b999261ddc4e tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:50.565427 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-111a4650-e662-41df-858c-b999261ddc4e tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:50.609678 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-e3eede15-f07a-465e-94bd-bf45dc7549d7 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47d51863b0448b880dc03b01dec6dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23568023763549669484e71430e34389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:50.617480 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-e3eede15-f07a-465e-94bd-bf45dc7549d7 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] 10.222.0.41 "GET /compute/v2.1/servers/2b1f3f01-d549-4e51-ae06-24500312482c" status: 200 len: 1266 microversion: 2.1 time: 0.165330 May 26 12:51:50.618084 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 311/613] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:51:50 2022] GET /compute/v2.1/servers/2b1f3f01-d549-4e51-ae06-24500312482c => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:50.695454 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-111a4650-e662-41df-858c-b999261ddc4e tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:50.703497 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-111a4650-e662-41df-858c-b999261ddc4e tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a" status: 200 len: 1520 microversion: 2.1 time: 0.150598 May 26 12:51:50.704073 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 303/614] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:51:50 2022] GET /compute/v2.1/servers/c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:51:51.634750 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-6667ffa7-9faa-4672-bf74-ec0af6bb5f04 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:51.635356 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-6667ffa7-9faa-4672-bf74-ec0af6bb5f04 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] [instance: 2b1f3f01-d549-4e51-ae06-24500312482c] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:51.642436 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-6667ffa7-9faa-4672-bf74-ec0af6bb5f04 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:51.642866 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-6667ffa7-9faa-4672-bf74-ec0af6bb5f04 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:51.643634 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-6667ffa7-9faa-4672-bf74-ec0af6bb5f04 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:51.644100 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-6667ffa7-9faa-4672-bf74-ec0af6bb5f04 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:51.720865 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-bef14db5-0db8-432d-8368-d97e9b90d8c1 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:51.721499 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-bef14db5-0db8-432d-8368-d97e9b90d8c1 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:51.728392 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-bef14db5-0db8-432d-8368-d97e9b90d8c1 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:51.728837 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-bef14db5-0db8-432d-8368-d97e9b90d8c1 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:51.729595 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-bef14db5-0db8-432d-8368-d97e9b90d8c1 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:51.730093 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-bef14db5-0db8-432d-8368-d97e9b90d8c1 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:51.779191 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-6667ffa7-9faa-4672-bf74-ec0af6bb5f04 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47d51863b0448b880dc03b01dec6dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23568023763549669484e71430e34389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:51.787699 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-6667ffa7-9faa-4672-bf74-ec0af6bb5f04 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] 10.222.0.41 "GET /compute/v2.1/servers/2b1f3f01-d549-4e51-ae06-24500312482c" status: 200 len: 1266 microversion: 2.1 time: 0.156763 May 26 12:51:51.788278 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 312/615] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:51:51 2022] GET /compute/v2.1/servers/2b1f3f01-d549-4e51-ae06-24500312482c => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:51:51.866444 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-bef14db5-0db8-432d-8368-d97e9b90d8c1 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:51.874298 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-bef14db5-0db8-432d-8368-d97e9b90d8c1 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a" status: 200 len: 1520 microversion: 2.1 time: 0.157303 May 26 12:51:51.874989 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 304/616] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:51:51 2022] GET /compute/v2.1/servers/c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:51:51.950169 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [req-a21d13fa-7125-44c6-90d6-bbe6d48f8d3b req-92b586a3-6a2c-4e34-b7fa-e83c7259ec82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b1f3f01-d549-4e51-ae06-24500312482c", "name": "network-vif-plugged", "status": "completed", "tag": "b5cef465-47cf-457a-a033-c7366a071c70"}]} {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:51:51.958380 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [req-a21d13fa-7125-44c6-90d6-bbe6d48f8d3b req-92b586a3-6a2c-4e34-b7fa-e83c7259ec82 service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:51.958830 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [req-a21d13fa-7125-44c6-90d6-bbe6d48f8d3b req-92b586a3-6a2c-4e34-b7fa-e83c7259ec82 service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:51.970165 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.compute.server_external_events [req-a21d13fa-7125-44c6-90d6-bbe6d48f8d3b req-92b586a3-6a2c-4e34-b7fa-e83c7259ec82 service nova] Creating event network-vif-plugged:b5cef465-47cf-457a-a033-c7366a071c70 for instance 2b1f3f01-d549-4e51-ae06-24500312482c on hv-cinder-81571 May 26 12:51:51.975334 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [req-a21d13fa-7125-44c6-90d6-bbe6d48f8d3b req-92b586a3-6a2c-4e34-b7fa-e83c7259ec82 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087561 May 26 12:51:51.975913 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 313/617] 10.222.0.41 () {64 vars in 1317 bytes} [Thu May 26 12:51:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:51:52.805455 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-04fcd1e3-02c2-4bac-8762-8046d31aeee0 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:52.806074 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-04fcd1e3-02c2-4bac-8762-8046d31aeee0 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] [instance: 2b1f3f01-d549-4e51-ae06-24500312482c] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:52.813017 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-04fcd1e3-02c2-4bac-8762-8046d31aeee0 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:52.813453 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-04fcd1e3-02c2-4bac-8762-8046d31aeee0 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:52.814238 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-04fcd1e3-02c2-4bac-8762-8046d31aeee0 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:52.814664 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-04fcd1e3-02c2-4bac-8762-8046d31aeee0 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:52.892917 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-b45e3498-0ff5-43db-bbe9-108342aee370 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:52.893623 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-b45e3498-0ff5-43db-bbe9-108342aee370 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:52.900966 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-b45e3498-0ff5-43db-bbe9-108342aee370 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:52.901437 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-b45e3498-0ff5-43db-bbe9-108342aee370 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:52.902467 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-b45e3498-0ff5-43db-bbe9-108342aee370 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:52.903139 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-b45e3498-0ff5-43db-bbe9-108342aee370 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:52.951132 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-04fcd1e3-02c2-4bac-8762-8046d31aeee0 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47d51863b0448b880dc03b01dec6dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23568023763549669484e71430e34389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:52.959047 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-04fcd1e3-02c2-4bac-8762-8046d31aeee0 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] 10.222.0.41 "GET /compute/v2.1/servers/2b1f3f01-d549-4e51-ae06-24500312482c" status: 200 len: 1266 microversion: 2.1 time: 0.157387 May 26 12:51:52.959927 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 305/618] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:51:52 2022] GET /compute/v2.1/servers/2b1f3f01-d549-4e51-ae06-24500312482c => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:53.037485 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-b45e3498-0ff5-43db-bbe9-108342aee370 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:53.045761 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-b45e3498-0ff5-43db-bbe9-108342aee370 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a" status: 200 len: 1520 microversion: 2.1 time: 0.157701 May 26 12:51:53.046347 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 314/619] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:51:52 2022] GET /compute/v2.1/servers/c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:51:53.788352 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [req-751db1cd-c991-4d71-ae86-51c62ff55df5 req-e7cfabdf-7522-4394-86d7-1bf8bae63fc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a", "name": "network-vif-deleted", "tag": "dde1860d-27af-458a-a7db-62514bcc9e27"}]} {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:51:53.796538 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [req-751db1cd-c991-4d71-ae86-51c62ff55df5 req-e7cfabdf-7522-4394-86d7-1bf8bae63fc8 service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:53.796980 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [req-751db1cd-c991-4d71-ae86-51c62ff55df5 req-e7cfabdf-7522-4394-86d7-1bf8bae63fc8 service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:53.809507 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.compute.server_external_events [req-751db1cd-c991-4d71-ae86-51c62ff55df5 req-e7cfabdf-7522-4394-86d7-1bf8bae63fc8 service nova] Creating event network-vif-deleted:dde1860d-27af-458a-a7db-62514bcc9e27 for instance c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a on hv-cinder-81571 May 26 12:51:53.814354 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [req-751db1cd-c991-4d71-ae86-51c62ff55df5 req-e7cfabdf-7522-4394-86d7-1bf8bae63fc8 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029613 May 26 12:51:53.814927 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 306/620] 10.222.0.41 () {64 vars in 1317 bytes} [Thu May 26 12:51:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:51:53.976609 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-e8c75fad-484d-4f1e-b2a9-c775eb973435 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:53.977231 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-e8c75fad-484d-4f1e-b2a9-c775eb973435 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] [instance: 2b1f3f01-d549-4e51-ae06-24500312482c] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:53.984659 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-e8c75fad-484d-4f1e-b2a9-c775eb973435 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:53.985402 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-e8c75fad-484d-4f1e-b2a9-c775eb973435 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:53.986089 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-e8c75fad-484d-4f1e-b2a9-c775eb973435 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:53.986557 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-e8c75fad-484d-4f1e-b2a9-c775eb973435 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:54.063392 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-87b894eb-4d47-4894-b76d-12752a410798 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:54.064091 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-87b894eb-4d47-4894-b76d-12752a410798 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:54.070755 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-87b894eb-4d47-4894-b76d-12752a410798 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:54.071208 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-87b894eb-4d47-4894-b76d-12752a410798 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:54.072123 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-87b894eb-4d47-4894-b76d-12752a410798 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:54.072407 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-87b894eb-4d47-4894-b76d-12752a410798 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:54.129705 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-e8c75fad-484d-4f1e-b2a9-c775eb973435 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47d51863b0448b880dc03b01dec6dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23568023763549669484e71430e34389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:54.138527 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-e8c75fad-484d-4f1e-b2a9-c775eb973435 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] 10.222.0.41 "GET /compute/v2.1/servers/2b1f3f01-d549-4e51-ae06-24500312482c" status: 200 len: 1266 microversion: 2.1 time: 0.165770 May 26 12:51:54.139115 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 315/621] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:51:53 2022] GET /compute/v2.1/servers/2b1f3f01-d549-4e51-ae06-24500312482c => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:54.148884 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-87b894eb-4d47-4894-b76d-12752a410798 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:54.157847 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-87b894eb-4d47-4894-b76d-12752a410798 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a" status: 200 len: 1306 microversion: 2.1 time: 0.098768 May 26 12:51:54.158442 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 307/622] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:51:54 2022] GET /compute/v2.1/servers/c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a => generated 1306 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:54.805527 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-62bb05c1-115c-40af-adb3-91bff412b4a1 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:54.806067 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-62bb05c1-115c-40af-adb3-91bff412b4a1 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 73592c9c-6dae-4521-a03d-e02749530cac] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:54.812874 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-62bb05c1-115c-40af-adb3-91bff412b4a1 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:54.826937 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-62bb05c1-115c-40af-adb3-91bff412b4a1 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:54.826937 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-62bb05c1-115c-40af-adb3-91bff412b4a1 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:54.826937 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-62bb05c1-115c-40af-adb3-91bff412b4a1 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:54.838834 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-62bb05c1-115c-40af-adb3-91bff412b4a1 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac/ips" status: 200 len: 153 microversion: 2.20 time: 0.138946 May 26 12:51:54.839924 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 316/623] 10.222.0.41 () {60 vars in 1288 bytes} [Thu May 26 12:51:54 2022] GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac/ips => generated 153 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 12:51:55.155503 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-3473af45-4449-4323-919f-112422f5b85c tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:55.156112 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-3473af45-4449-4323-919f-112422f5b85c tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] [instance: 2b1f3f01-d549-4e51-ae06-24500312482c] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:55.162633 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-3473af45-4449-4323-919f-112422f5b85c tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:55.163205 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-3473af45-4449-4323-919f-112422f5b85c tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:55.163971 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-3473af45-4449-4323-919f-112422f5b85c tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:55.164397 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-3473af45-4449-4323-919f-112422f5b85c tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:55.174998 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-70a63392-0614-48bd-8743-ed3754ad3e17 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:55.175776 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-70a63392-0614-48bd-8743-ed3754ad3e17 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:55.182507 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-70a63392-0614-48bd-8743-ed3754ad3e17 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:55.191817 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-70a63392-0614-48bd-8743-ed3754ad3e17 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:55.191817 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-70a63392-0614-48bd-8743-ed3754ad3e17 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:55.191817 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-70a63392-0614-48bd-8743-ed3754ad3e17 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:55.216873 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-70a63392-0614-48bd-8743-ed3754ad3e17 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:55.217323 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-70a63392-0614-48bd-8743-ed3754ad3e17 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:55.217808 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.objects.instance [None req-70a63392-0614-48bd-8743-ed3754ad3e17 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lazy-loading 'fault' on Instance uuid c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a {{(pid=124823) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:51:55.264074 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-70a63392-0614-48bd-8743-ed3754ad3e17 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf98a4d33cab49b08640f437dbfb2dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930a0f4448d4ef0a6030da17a36257a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:55.272392 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-70a63392-0614-48bd-8743-ed3754ad3e17 tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a" status: 200 len: 1311 microversion: 2.1 time: 0.101375 May 26 12:51:55.272990 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 317/624] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:51:55 2022] GET /compute/v2.1/servers/c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a => generated 1311 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:55.318314 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-3473af45-4449-4323-919f-112422f5b85c tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47d51863b0448b880dc03b01dec6dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23568023763549669484e71430e34389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:55.327009 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-3473af45-4449-4323-919f-112422f5b85c tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] 10.222.0.41 "GET /compute/v2.1/servers/2b1f3f01-d549-4e51-ae06-24500312482c" status: 200 len: 1266 microversion: 2.1 time: 0.175170 May 26 12:51:55.336500 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 308/625] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:51:55 2022] GET /compute/v2.1/servers/2b1f3f01-d549-4e51-ae06-24500312482c => generated 1266 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:56.142764 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-810f0dc9-54bf-4f22-bc92-885faa5398bd tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "079573b3-90ce-43da-a220-af08c0c7c482"}} {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:51:56.143908 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-810f0dc9-54bf-4f22-bc92-885faa5398bd tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: 1b2f404c-1ca9-4904-944c-16685c8f68c5] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:56.146055 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG dbcounter [-] [124823] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=124823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:51:56.150812 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-810f0dc9-54bf-4f22-bc92-885faa5398bd tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:56.151253 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-810f0dc9-54bf-4f22-bc92-885faa5398bd tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:56.152080 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-810f0dc9-54bf-4f22-bc92-885faa5398bd tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:56.152502 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-810f0dc9-54bf-4f22-bc92-885faa5398bd tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:56.232282 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.wsgi [None req-810f0dc9-54bf-4f22-bc92-885faa5398bd tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] HTTP exception thrown: Invalid volume: volume 079573b3-90ce-43da-a220-af08c0c7c482 is already attached to instances: 1b2f404c-1ca9-4904-944c-16685c8f68c5 May 26 12:51:56.234058 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-810f0dc9-54bf-4f22-bc92-885faa5398bd tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Request method failure captured: May 26 12:51:56.234058 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: request: POST /compute/v2.1/servers/1b2f404c-1ca9-4904-944c-16685c8f68c5/os-volume_attachments HTTP/1.1 May 26 12:51:56.234058 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Accept: application/json May 26 12:51:56.234058 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Accept-Encoding: identity May 26 12:51:56.234058 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Connection: close May 26 12:51:56.234058 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Content-Length: 74 May 26 12:51:56.234058 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Content-Type: application/json May 26 12:51:56.234058 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Host: 10.222.0.41 May 26 12:51:56.234058 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Openstack-System-Scope: None May 26 12:51:56.234058 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: User-Agent: python-urllib3/1.26.9 May 26 12:51:56.234058 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Auth-Token: gAAAAABij3aYTDT6d91IIen8MNgNrsA0ohBGn_dUC2tsponOFwNurwjlknBmFB36blSobobmDRibGa26en17LZfjuhgOSZiQsswJxea6OZWaEAKHfDkIbtu7XpKpGW-ZBZHCz2dZb9rYCBos_UyGkZJY7k8n757Ijkdz5EguRL9a0MDFor49yAU May 26 12:51:56.234058 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Domain-Id: None May 26 12:51:56.234058 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Domain-Name: None May 26 12:51:56.234058 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Identity-Status: Confirmed May 26 12:51:56.234058 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Is-Admin-Project: True May 26 12:51:56.234058 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Project-Domain-Id: default May 26 12:51:56.234058 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Project-Domain-Name: Default May 26 12:51:56.234058 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Project-Id: cad768b45d17480d8d6bbbcff6032c8d May 26 12:51:56.234058 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Project-Name: tempest-AttachVolumeNegativeTest-155076248 May 26 12:51:56.234058 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Role: member,reader May 26 12:51:56.234058 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Roles: member,reader May 26 12:51:56.235358 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/cad768b45d17480d8d6bbbcff6032c8d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/cad768b45d17480d8d6bbbcff6032c8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/cad768b45d17480d8d6bbbcff6032c8d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_cad768b45d17480d8d6bbbcff6032c8d", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 26 12:51:56.235358 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Tenant: tempest-AttachVolumeNegativeTest-155076248 May 26 12:51:56.235358 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Tenant-Id: cad768b45d17480d8d6bbbcff6032c8d May 26 12:51:56.235358 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-155076248 May 26 12:51:56.235358 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User: tempest-AttachVolumeNegativeTest-155076248-project May 26 12:51:56.235358 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User-Domain-Id: default May 26 12:51:56.235358 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User-Domain-Name: Default May 26 12:51:56.235358 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User-Id: 0537911b91184fcdbdcc9e93ec3fe5b9 May 26 12:51:56.235358 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User-Name: tempest-AttachVolumeNegativeTest-155076248-project May 26 12:51:56.235358 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: May 26 12:51:56.235358 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: {"volumeAttachment": {"volumeId": "079573b3-90ce-43da-a220-af08c0c7c482"}} May 26 12:51:56.235358 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: method: > May 26 12:51:56.236070 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: exception: Invalid volume: volume 079573b3-90ce-43da-a220-af08c0c7c482 is already attached to instances: 1b2f404c-1ca9-4904-944c-16685c8f68c5 May 26 12:51:56.236070 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: action_args: {'server_id': '1b2f404c-1ca9-4904-944c-16685c8f68c5', 'body': {'volumeAttachment': {'volumeId': '079573b3-90ce-43da-a220-af08c0c7c482'}}} May 26 12:51:56.236070 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:51:56.236070 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:51:56.236070 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 26 12:51:56.236070 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 26 12:51:56.236070 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 26 12:51:56.236070 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 12:51:56.236070 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 26 12:51:56.236070 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 26 12:51:56.236070 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 26 12:51:56.236070 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 26 12:51:56.236070 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 26 12:51:56.236070 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 26 12:51:56.236070 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 079573b3-90ce-43da-a220-af08c0c7c482 is already attached to instances: 1b2f404c-1ca9-4904-944c-16685c8f68c5 May 26 12:51:56.236070 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:51:56.236070 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:51:56.236070 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:51:56.236070 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:51:56.237443 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:51:56.237443 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:51:56.237443 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:51:56.237443 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:51:56.237443 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:51:56.237443 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:51:56.237443 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 12:51:56.237443 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 12:51:56.237443 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 12:51:56.237443 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 12:51:56.237443 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 12:51:56.237443 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 12:51:56.237443 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 26 12:51:56.237443 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 26 12:51:56.237443 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 079573b3-90ce-43da-a220-af08c0c7c482 is already attached to instances: 1b2f404c-1ca9-4904-944c-16685c8f68c5 May 26 12:51:56.237443 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:51:56.237443 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:51:56.237443 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:51:56.237443 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:51:56.237443 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:51:56.238923 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:51:56.238923 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:51:56.238923 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:51:56.238923 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 079573b3-90ce-43da-a220-af08c0c7c482 is already attached to instances: 1b2f404c-1ca9-4904-944c-16685c8f68c5 May 26 12:51:56.238923 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:51:56.238923 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-810f0dc9-54bf-4f22-bc92-885faa5398bd tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Returning 400 to user: Invalid volume: volume 079573b3-90ce-43da-a220-af08c0c7c482 is already attached to instances: 1b2f404c-1ca9-4904-944c-16685c8f68c5 {{(pid=124823) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:51:56.238923 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-810f0dc9-54bf-4f22-bc92-885faa5398bd tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "POST /compute/v2.1/servers/1b2f404c-1ca9-4904-944c-16685c8f68c5/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.096831 May 26 12:51:56.238923 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 318/626] 10.222.0.41 () {60 vars in 1322 bytes} [Thu May 26 12:51:56 2022] POST /compute/v2.1/servers/1b2f404c-1ca9-4904-944c-16685c8f68c5/os-volume_attachments => generated 174 bytes in 98 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 26 12:51:56.289288 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-3470faca-5d62-499b-aa7a-d1e3dea3648e tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:56.289916 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-3470faca-5d62-499b-aa7a-d1e3dea3648e tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] [instance: c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:56.296619 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-3470faca-5d62-499b-aa7a-d1e3dea3648e tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:56.297066 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-3470faca-5d62-499b-aa7a-d1e3dea3648e tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:56.297179 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-9e2fadb3-239d-46fa-b235-f74b41f67124 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:56.297745 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-9e2fadb3-239d-46fa-b235-f74b41f67124 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: 1b2f404c-1ca9-4904-944c-16685c8f68c5] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:56.297862 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-3470faca-5d62-499b-aa7a-d1e3dea3648e tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:56.298296 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-3470faca-5d62-499b-aa7a-d1e3dea3648e tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:56.305418 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-9e2fadb3-239d-46fa-b235-f74b41f67124 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:56.305900 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-9e2fadb3-239d-46fa-b235-f74b41f67124 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:56.306670 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-9e2fadb3-239d-46fa-b235-f74b41f67124 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:56.307107 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-9e2fadb3-239d-46fa-b235-f74b41f67124 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:56.312843 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.wsgi [None req-3470faca-5d62-499b-aa7a-d1e3dea3648e tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] HTTP exception thrown: Instance c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a could not be found. May 26 12:51:56.314570 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-3470faca-5d62-499b-aa7a-d1e3dea3648e tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Request method failure captured: May 26 12:51:56.314570 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: request: GET /compute/v2.1/servers/c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a HTTP/1.1 May 26 12:51:56.314570 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Accept: application/json May 26 12:51:56.314570 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Accept-Encoding: identity May 26 12:51:56.314570 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Connection: close May 26 12:51:56.314570 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Content-Length: 0 May 26 12:51:56.314570 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Content-Type: application/json May 26 12:51:56.314570 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Host: 10.222.0.41 May 26 12:51:56.314570 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Openstack-System-Scope: None May 26 12:51:56.314570 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: User-Agent: python-urllib3/1.26.9 May 26 12:51:56.314570 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Auth-Token: gAAAAABij3aX6bwsviEkeUYewj-xlndiK1bsPBf92DMS42pl4gfoAWpT2Nwqjxg-XMZou9-CFzmPCmtZ9TjM3zfCdG4bAle_MvCdrJrquNKcFpkWDFLqcD6Kq3oa26r5AlaY0DKFiwUUVBB5lqaRpwXOXIz3ew4L1IUMZ8-eR1xMR1hG_1d6fpk May 26 12:51:56.314570 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Domain-Id: None May 26 12:51:56.314570 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Domain-Name: None May 26 12:51:56.314570 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Identity-Status: Confirmed May 26 12:51:56.314570 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Is-Admin-Project: True May 26 12:51:56.314570 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Domain-Id: default May 26 12:51:56.314570 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Domain-Name: Default May 26 12:51:56.314570 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Id: 9930a0f4448d4ef0a6030da17a36257a May 26 12:51:56.314570 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1873359870 May 26 12:51:56.314570 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Role: member,reader May 26 12:51:56.314570 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Roles: member,reader May 26 12:51:56.315923 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/9930a0f4448d4ef0a6030da17a36257a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/9930a0f4448d4ef0a6030da17a36257a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/9930a0f4448d4ef0a6030da17a36257a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_9930a0f4448d4ef0a6030da17a36257a", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 26 12:51:56.315923 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1873359870 May 26 12:51:56.315923 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Tenant-Id: 9930a0f4448d4ef0a6030da17a36257a May 26 12:51:56.315923 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1873359870 May 26 12:51:56.315923 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User: tempest-ServerRescueNegativeTestJSON-1873359870-project May 26 12:51:56.315923 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Domain-Id: default May 26 12:51:56.315923 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Domain-Name: Default May 26 12:51:56.315923 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Id: cf98a4d33cab49b08640f437dbfb2dc8 May 26 12:51:56.315923 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1873359870-project May 26 12:51:56.315923 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: method: > May 26 12:51:56.315923 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: exception: Instance c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a could not be found. May 26 12:51:56.315923 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: action_args: {'id': 'c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a'} May 26 12:51:56.316637 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:51:56.316637 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:51:56.316637 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:51:56.316637 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:51:56.316637 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:51:56.316637 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:51:56.316637 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:51:56.316637 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:51:56.316637 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:51:56.316637 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:51:56.316637 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a could not be found. May 26 12:51:56.316637 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:51:56.316637 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:51:56.316637 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:51:56.316637 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:51:56.316637 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:51:56.316637 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:51:56.316637 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:51:56.316637 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:51:56.316637 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:51:56.317867 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:51:56.317867 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 12:51:56.317867 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 12:51:56.317867 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:51:56.317867 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:51:56.317867 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:51:56.317867 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:51:56.317867 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a could not be found. May 26 12:51:56.317867 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:51:56.317867 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:51:56.317867 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:51:56.317867 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:51:56.317867 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:51:56.317867 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:51:56.317867 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:51:56.317867 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:51:56.317867 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a could not be found. May 26 12:51:56.317867 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:51:56.318943 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-3470faca-5d62-499b-aa7a-d1e3dea3648e tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] Returning 404 to user: Instance c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a could not be found. {{(pid=124824) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:51:56.318943 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-3470faca-5d62-499b-aa7a-d1e3dea3648e tempest-ServerRescueNegativeTestJSON-1873359870 tempest-ServerRescueNegativeTestJSON-1873359870-project] 10.222.0.41 "GET /compute/v2.1/servers/c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a" status: 404 len: 111 microversion: 2.1 time: 0.030543 May 26 12:51:56.318943 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 309/627] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:51:56 2022] GET /compute/v2.1/servers/c6e14c6f-f7b5-45d3-b07e-3ca68dfb281a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:51:56.343981 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-979553ef-5441-45af-9ba4-f7cfa65e8f97 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:56.344721 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-979553ef-5441-45af-9ba4-f7cfa65e8f97 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] [instance: 2b1f3f01-d549-4e51-ae06-24500312482c] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:56.353630 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-979553ef-5441-45af-9ba4-f7cfa65e8f97 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:56.354127 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-979553ef-5441-45af-9ba4-f7cfa65e8f97 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:56.354948 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-979553ef-5441-45af-9ba4-f7cfa65e8f97 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:56.355784 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-979553ef-5441-45af-9ba4-f7cfa65e8f97 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:56.396662 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.objects.instance [None req-9e2fadb3-239d-46fa-b235-f74b41f67124 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lazy-loading 'services' on Instance uuid 1b2f404c-1ca9-4904-944c-16685c8f68c5 {{(pid=124823) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:51:56.502293 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-979553ef-5441-45af-9ba4-f7cfa65e8f97 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47d51863b0448b880dc03b01dec6dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23568023763549669484e71430e34389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:56.515893 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-979553ef-5441-45af-9ba4-f7cfa65e8f97 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] 10.222.0.41 "GET /compute/v2.1/servers/2b1f3f01-d549-4e51-ae06-24500312482c" status: 200 len: 1453 microversion: 2.1 time: 0.175334 May 26 12:51:56.517373 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 310/628] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:51:56 2022] GET /compute/v2.1/servers/2b1f3f01-d549-4e51-ae06-24500312482c => generated 1453 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:51:56.533218 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-2e8197a6-82b5-4f9c-bac8-3ca5698830ec tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:56.534089 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-2e8197a6-82b5-4f9c-bac8-3ca5698830ec tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] [instance: 2b1f3f01-d549-4e51-ae06-24500312482c] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:56.540295 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-2e8197a6-82b5-4f9c-bac8-3ca5698830ec tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:56.540705 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-2e8197a6-82b5-4f9c-bac8-3ca5698830ec tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:56.541691 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-2e8197a6-82b5-4f9c-bac8-3ca5698830ec tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:56.542133 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-2e8197a6-82b5-4f9c-bac8-3ca5698830ec tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:56.620377 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-9e2fadb3-239d-46fa-b235-f74b41f67124 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "DELETE /compute/v2.1/servers/1b2f404c-1ca9-4904-944c-16685c8f68c5/os-volume_attachments/079573b3-90ce-43da-a220-af08c0c7c482" status: 202 len: 0 microversion: 2.1 time: 0.327101 May 26 12:51:56.622820 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 319/629] 10.222.0.41 () {58 vars in 1415 bytes} [Thu May 26 12:51:56 2022] DELETE /compute/v2.1/servers/1b2f404c-1ca9-4904-944c-16685c8f68c5/os-volume_attachments/079573b3-90ce-43da-a220-af08c0c7c482 => generated 0 bytes in 330 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 26 12:51:56.637398 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-71cb73cd-e76c-4df0-b858-19a6bf5e657c tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:56.638532 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-71cb73cd-e76c-4df0-b858-19a6bf5e657c tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: 1b2f404c-1ca9-4904-944c-16685c8f68c5] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:56.646584 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-71cb73cd-e76c-4df0-b858-19a6bf5e657c tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:56.647305 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-71cb73cd-e76c-4df0-b858-19a6bf5e657c tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:56.648911 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-71cb73cd-e76c-4df0-b858-19a6bf5e657c tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:56.650616 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-71cb73cd-e76c-4df0-b858-19a6bf5e657c tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:56.688962 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-71cb73cd-e76c-4df0-b858-19a6bf5e657c tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "GET /compute/v2.1/servers/1b2f404c-1ca9-4904-944c-16685c8f68c5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061853 May 26 12:51:56.690991 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 320/630] 10.222.0.41 () {58 vars in 1301 bytes} [Thu May 26 12:51:56 2022] GET /compute/v2.1/servers/1b2f404c-1ca9-4904-944c-16685c8f68c5/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:51:56.707411 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-2e8197a6-82b5-4f9c-bac8-3ca5698830ec tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47d51863b0448b880dc03b01dec6dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23568023763549669484e71430e34389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:56.714960 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-2e8197a6-82b5-4f9c-bac8-3ca5698830ec tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] 10.222.0.41 "GET /compute/v2.1/servers/2b1f3f01-d549-4e51-ae06-24500312482c" status: 200 len: 1453 microversion: 2.1 time: 0.186094 May 26 12:51:56.715558 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 311/631] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:51:56 2022] GET /compute/v2.1/servers/2b1f3f01-d549-4e51-ae06-24500312482c => generated 1453 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:51:57.338506 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-5db0b944-fbeb-4abc-8363-26bb0f824d55 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:51:57.339081 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-5db0b944-fbeb-4abc-8363-26bb0f824d55 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 73592c9c-6dae-4521-a03d-e02749530cac] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:57.346423 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-5db0b944-fbeb-4abc-8363-26bb0f824d55 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:57.351465 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-5db0b944-fbeb-4abc-8363-26bb0f824d55 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:57.351465 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-5db0b944-fbeb-4abc-8363-26bb0f824d55 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:57.351465 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-5db0b944-fbeb-4abc-8363-26bb0f824d55 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:57.371503 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.objects.instance [None req-5db0b944-fbeb-4abc-8363-26bb0f824d55 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lazy-loading 'flavor' on Instance uuid 73592c9c-6dae-4521-a03d-e02749530cac {{(pid=124823) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:51:57.606431 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG dbcounter [-] [124823] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=124823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:51:57.716939 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-8821fbb7-42d6-4a84-975b-64c4e2115a57 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:57.718812 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-8821fbb7-42d6-4a84-975b-64c4e2115a57 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: 1b2f404c-1ca9-4904-944c-16685c8f68c5] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:57.726855 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-8821fbb7-42d6-4a84-975b-64c4e2115a57 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:57.727563 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-8821fbb7-42d6-4a84-975b-64c4e2115a57 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:57.728375 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-8821fbb7-42d6-4a84-975b-64c4e2115a57 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:57.728805 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-8821fbb7-42d6-4a84-975b-64c4e2115a57 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:57.760481 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-8821fbb7-42d6-4a84-975b-64c4e2115a57 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "GET /compute/v2.1/servers/1b2f404c-1ca9-4904-944c-16685c8f68c5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048409 May 26 12:51:57.761040 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 312/632] 10.222.0.41 () {58 vars in 1301 bytes} [Thu May 26 12:51:57 2022] GET /compute/v2.1/servers/1b2f404c-1ca9-4904-944c-16685c8f68c5/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 26 12:51:57.831885 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-f92115de-1ccf-4bdc-918c-a0304c561fae tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:57.832325 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-f92115de-1ccf-4bdc-918c-a0304c561fae tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: 1b2f404c-1ca9-4904-944c-16685c8f68c5] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:57.840421 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-f92115de-1ccf-4bdc-918c-a0304c561fae tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:57.842571 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-f92115de-1ccf-4bdc-918c-a0304c561fae tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:57.845045 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-f92115de-1ccf-4bdc-918c-a0304c561fae tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:57.845179 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-f92115de-1ccf-4bdc-918c-a0304c561fae tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:57.890269 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-f92115de-1ccf-4bdc-918c-a0304c561fae tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: 1b2f404c-1ca9-4904-944c-16685c8f68c5] Going to try to terminate instance {{(pid=124824) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 12:51:57.932192 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG dbcounter [-] [124824] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:51:58.044917 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-5db0b944-fbeb-4abc-8363-26bb0f824d55 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "POST /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac/action" status: 202 len: 0 microversion: 2.20 time: 0.710091 May 26 12:51:58.050916 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 321/633] 10.222.0.41 () {62 vars in 1318 bytes} [Thu May 26 12:51:57 2022] POST /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac/action => generated 0 bytes in 712 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 26 12:51:58.055258 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-d3413561-61ac-460b-b420-dc1d2b42181a tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:58.056269 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-d3413561-61ac-460b-b420-dc1d2b42181a tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 73592c9c-6dae-4521-a03d-e02749530cac] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:58.064468 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-d3413561-61ac-460b-b420-dc1d2b42181a tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:58.064936 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-d3413561-61ac-460b-b420-dc1d2b42181a tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:58.065746 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-d3413561-61ac-460b-b420-dc1d2b42181a tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:58.066190 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-d3413561-61ac-460b-b420-dc1d2b42181a tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:58.158112 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG dbcounter [-] [124824] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=2 {{(pid=124824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:51:58.340004 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-d3413561-61ac-460b-b420-dc1d2b42181a tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:58.350323 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-d3413561-61ac-460b-b420-dc1d2b42181a tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:58.352143 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-d3413561-61ac-460b-b420-dc1d2b42181a tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:58.353355 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-d3413561-61ac-460b-b420-dc1d2b42181a tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac" status: 200 len: 1725 microversion: 2.20 time: 0.303009 May 26 12:51:58.354142 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 322/634] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:51:58 2022] GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac => generated 1725 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:51:58.378901 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-f92115de-1ccf-4bdc-918c-a0304c561fae tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "DELETE /compute/v2.1/servers/1b2f404c-1ca9-4904-944c-16685c8f68c5" status: 204 len: 0 microversion: 2.1 time: 0.551601 May 26 12:51:58.379753 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 313/635] 10.222.0.41 () {58 vars in 1238 bytes} [Thu May 26 12:51:57 2022] DELETE /compute/v2.1/servers/1b2f404c-1ca9-4904-944c-16685c8f68c5 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 12:51:58.388466 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-c5e06f1e-e879-427c-82bd-e91373d7cfb3 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:58.389089 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-c5e06f1e-e879-427c-82bd-e91373d7cfb3 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: 1b2f404c-1ca9-4904-944c-16685c8f68c5] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:58.395999 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-c5e06f1e-e879-427c-82bd-e91373d7cfb3 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:58.396545 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-c5e06f1e-e879-427c-82bd-e91373d7cfb3 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:58.397424 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-c5e06f1e-e879-427c-82bd-e91373d7cfb3 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:58.398006 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-c5e06f1e-e879-427c-82bd-e91373d7cfb3 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:58.745615 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-c5e06f1e-e879-427c-82bd-e91373d7cfb3 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0537911b91184fcdbdcc9e93ec3fe5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad768b45d17480d8d6bbbcff6032c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:58.756498 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-c5e06f1e-e879-427c-82bd-e91373d7cfb3 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "GET /compute/v2.1/servers/1b2f404c-1ca9-4904-944c-16685c8f68c5" status: 200 len: 1680 microversion: 2.1 time: 0.371538 May 26 12:51:58.757891 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 323/636] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:51:58 2022] GET /compute/v2.1/servers/1b2f404c-1ca9-4904-944c-16685c8f68c5 => generated 1680 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:51:59.220317 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [req-05bd3bea-e832-444d-b517-029a23f3d2cf req-67b7b9c5-2665-48e2-9945-b959ff062b71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b1f3f01-d549-4e51-ae06-24500312482c", "tag": "b5cef465-47cf-457a-a033-c7366a071c70"}]} {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:51:59.230136 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [req-05bd3bea-e832-444d-b517-029a23f3d2cf req-67b7b9c5-2665-48e2-9945-b959ff062b71 service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:59.230582 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [req-05bd3bea-e832-444d-b517-029a23f3d2cf req-67b7b9c5-2665-48e2-9945-b959ff062b71 service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:59.241975 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.compute.server_external_events [req-05bd3bea-e832-444d-b517-029a23f3d2cf req-67b7b9c5-2665-48e2-9945-b959ff062b71 service nova] Creating event network-changed:b5cef465-47cf-457a-a033-c7366a071c70 for instance 2b1f3f01-d549-4e51-ae06-24500312482c on hv-cinder-81571 May 26 12:51:59.247448 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [req-05bd3bea-e832-444d-b517-029a23f3d2cf req-67b7b9c5-2665-48e2-9945-b959ff062b71 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031661 May 26 12:51:59.248053 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 314/637] 10.222.0.41 () {64 vars in 1317 bytes} [Thu May 26 12:51:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:51:59.373565 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-18075761-14de-49bd-a422-501c5c4ae273 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:59.374285 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-18075761-14de-49bd-a422-501c5c4ae273 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 73592c9c-6dae-4521-a03d-e02749530cac] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:59.380950 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-18075761-14de-49bd-a422-501c5c4ae273 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:59.381396 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-18075761-14de-49bd-a422-501c5c4ae273 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:59.382987 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-18075761-14de-49bd-a422-501c5c4ae273 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:59.382987 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-18075761-14de-49bd-a422-501c5c4ae273 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:59.708407 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-18075761-14de-49bd-a422-501c5c4ae273 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:59.718658 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-18075761-14de-49bd-a422-501c5c4ae273 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:59.730734 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-18075761-14de-49bd-a422-501c5c4ae273 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:59.730734 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-18075761-14de-49bd-a422-501c5c4ae273 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac" status: 200 len: 1725 microversion: 2.20 time: 0.352613 May 26 12:51:59.730734 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 324/638] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:51:59 2022] GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac => generated 1725 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:51:59.776052 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-e50488f9-d0de-447c-838c-61fd52090895 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:51:59.776830 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-e50488f9-d0de-447c-838c-61fd52090895 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: 1b2f404c-1ca9-4904-944c-16685c8f68c5] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:51:59.784815 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-e50488f9-d0de-447c-838c-61fd52090895 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:59.785877 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-e50488f9-d0de-447c-838c-61fd52090895 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:59.786679 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-e50488f9-d0de-447c-838c-61fd52090895 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:51:59.787123 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-e50488f9-d0de-447c-838c-61fd52090895 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:51:59.965805 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-e50488f9-d0de-447c-838c-61fd52090895 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0537911b91184fcdbdcc9e93ec3fe5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad768b45d17480d8d6bbbcff6032c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:51:59.975386 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-e50488f9-d0de-447c-838c-61fd52090895 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "GET /compute/v2.1/servers/1b2f404c-1ca9-4904-944c-16685c8f68c5" status: 200 len: 1680 microversion: 2.1 time: 0.204248 May 26 12:51:59.982597 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 315/639] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:51:59 2022] GET /compute/v2.1/servers/1b2f404c-1ca9-4904-944c-16685c8f68c5 => generated 1680 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:52:00.740481 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-1098bc20-ec3e-49f2-a219-ea8588067ca5 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:00.741092 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-1098bc20-ec3e-49f2-a219-ea8588067ca5 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 73592c9c-6dae-4521-a03d-e02749530cac] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:00.749335 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-1098bc20-ec3e-49f2-a219-ea8588067ca5 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:00.758198 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-1098bc20-ec3e-49f2-a219-ea8588067ca5 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:00.758198 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-1098bc20-ec3e-49f2-a219-ea8588067ca5 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:00.758198 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-1098bc20-ec3e-49f2-a219-ea8588067ca5 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:00.994040 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-cd48356d-0133-4e79-820b-af75aa5ba1c2 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:00.995576 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-cd48356d-0133-4e79-820b-af75aa5ba1c2 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: 1b2f404c-1ca9-4904-944c-16685c8f68c5] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:01.007764 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-cd48356d-0133-4e79-820b-af75aa5ba1c2 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:01.008128 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-cd48356d-0133-4e79-820b-af75aa5ba1c2 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:01.009001 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-cd48356d-0133-4e79-820b-af75aa5ba1c2 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:01.009430 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-cd48356d-0133-4e79-820b-af75aa5ba1c2 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:01.010899 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-1098bc20-ec3e-49f2-a219-ea8588067ca5 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:01.035154 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-1098bc20-ec3e-49f2-a219-ea8588067ca5 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:01.048378 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-1098bc20-ec3e-49f2-a219-ea8588067ca5 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:01.048378 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-1098bc20-ec3e-49f2-a219-ea8588067ca5 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac" status: 200 len: 1725 microversion: 2.20 time: 0.301379 May 26 12:52:01.050956 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 325/640] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:52:00 2022] GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac => generated 1725 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:52:01.241078 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-cd48356d-0133-4e79-820b-af75aa5ba1c2 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0537911b91184fcdbdcc9e93ec3fe5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad768b45d17480d8d6bbbcff6032c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:01.249808 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-cd48356d-0133-4e79-820b-af75aa5ba1c2 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "GET /compute/v2.1/servers/1b2f404c-1ca9-4904-944c-16685c8f68c5" status: 200 len: 1680 microversion: 2.1 time: 0.259876 May 26 12:52:01.250450 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 316/641] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:52:00 2022] GET /compute/v2.1/servers/1b2f404c-1ca9-4904-944c-16685c8f68c5 => generated 1680 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:52:02.057888 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-e7bdb0f7-6e5c-4874-977b-ceef94a1e0ce tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:02.058763 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-e7bdb0f7-6e5c-4874-977b-ceef94a1e0ce tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 73592c9c-6dae-4521-a03d-e02749530cac] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:02.067958 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-e7bdb0f7-6e5c-4874-977b-ceef94a1e0ce tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:02.075186 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-e7bdb0f7-6e5c-4874-977b-ceef94a1e0ce tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:02.075186 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-e7bdb0f7-6e5c-4874-977b-ceef94a1e0ce tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:02.075186 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-e7bdb0f7-6e5c-4874-977b-ceef94a1e0ce tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:02.117142 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [req-170f26f5-28e0-4fe3-aa36-24be66b1aa44 req-7f5bfe15-14c1-4d22-9e34-66655e2bc2ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b2f404c-1ca9-4904-944c-16685c8f68c5", "name": "network-vif-deleted", "tag": "a3a568a1-60df-415d-9fd4-02eab3f0bfce"}]} {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:52:02.134258 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [req-170f26f5-28e0-4fe3-aa36-24be66b1aa44 req-7f5bfe15-14c1-4d22-9e34-66655e2bc2ff service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:02.136156 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [req-170f26f5-28e0-4fe3-aa36-24be66b1aa44 req-7f5bfe15-14c1-4d22-9e34-66655e2bc2ff service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:02.153993 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.compute.server_external_events [req-170f26f5-28e0-4fe3-aa36-24be66b1aa44 req-7f5bfe15-14c1-4d22-9e34-66655e2bc2ff service nova] Creating event network-vif-deleted:a3a568a1-60df-415d-9fd4-02eab3f0bfce for instance 1b2f404c-1ca9-4904-944c-16685c8f68c5 on hv-cinder-81571 May 26 12:52:02.159803 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [req-170f26f5-28e0-4fe3-aa36-24be66b1aa44 req-7f5bfe15-14c1-4d22-9e34-66655e2bc2ff service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047332 May 26 12:52:02.160541 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 317/642] 10.222.0.41 () {64 vars in 1317 bytes} [Thu May 26 12:52:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:52:02.210382 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-e7bdb0f7-6e5c-4874-977b-ceef94a1e0ce tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:02.218965 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-e7bdb0f7-6e5c-4874-977b-ceef94a1e0ce tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:02.220483 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-e7bdb0f7-6e5c-4874-977b-ceef94a1e0ce tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:02.221738 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-e7bdb0f7-6e5c-4874-977b-ceef94a1e0ce tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac" status: 200 len: 1725 microversion: 2.20 time: 0.168208 May 26 12:52:02.222563 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 326/643] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:52:02 2022] GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac => generated 1725 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:52:02.268364 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-12964974-68ff-4f47-ad88-de255541a6f5 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:02.269066 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-12964974-68ff-4f47-ad88-de255541a6f5 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: 1b2f404c-1ca9-4904-944c-16685c8f68c5] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:02.275508 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-12964974-68ff-4f47-ad88-de255541a6f5 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:02.275952 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-12964974-68ff-4f47-ad88-de255541a6f5 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:02.276715 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-12964974-68ff-4f47-ad88-de255541a6f5 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:02.280904 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-12964974-68ff-4f47-ad88-de255541a6f5 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:02.347704 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-12964974-68ff-4f47-ad88-de255541a6f5 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0537911b91184fcdbdcc9e93ec3fe5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad768b45d17480d8d6bbbcff6032c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:02.357002 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-12964974-68ff-4f47-ad88-de255541a6f5 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "GET /compute/v2.1/servers/1b2f404c-1ca9-4904-944c-16685c8f68c5" status: 200 len: 1613 microversion: 2.1 time: 0.092757 May 26 12:52:02.357591 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 318/644] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:52:02 2022] GET /compute/v2.1/servers/1b2f404c-1ca9-4904-944c-16685c8f68c5 => generated 1613 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:52:03.240552 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-77c196ed-9317-448f-ac43-80d8b6536f10 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:03.241167 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-77c196ed-9317-448f-ac43-80d8b6536f10 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 73592c9c-6dae-4521-a03d-e02749530cac] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:03.247893 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-77c196ed-9317-448f-ac43-80d8b6536f10 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:03.248341 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-77c196ed-9317-448f-ac43-80d8b6536f10 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:03.249117 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-77c196ed-9317-448f-ac43-80d8b6536f10 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:03.249551 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-77c196ed-9317-448f-ac43-80d8b6536f10 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:03.375142 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-2a9f0e96-f252-466d-90bb-f71544c05bba tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:03.376381 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-2a9f0e96-f252-466d-90bb-f71544c05bba tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: 1b2f404c-1ca9-4904-944c-16685c8f68c5] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:03.384191 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-2a9f0e96-f252-466d-90bb-f71544c05bba tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:03.384666 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-2a9f0e96-f252-466d-90bb-f71544c05bba tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:03.385467 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-2a9f0e96-f252-466d-90bb-f71544c05bba tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:03.385935 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-2a9f0e96-f252-466d-90bb-f71544c05bba tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:03.389779 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-77c196ed-9317-448f-ac43-80d8b6536f10 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:03.409802 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-77c196ed-9317-448f-ac43-80d8b6536f10 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:03.411344 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-77c196ed-9317-448f-ac43-80d8b6536f10 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:03.412687 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-77c196ed-9317-448f-ac43-80d8b6536f10 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac" status: 200 len: 1725 microversion: 2.20 time: 0.176185 May 26 12:52:03.413254 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 327/645] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:52:03 2022] GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac => generated 1725 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:52:03.439737 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-2a9f0e96-f252-466d-90bb-f71544c05bba tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:03.440178 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-2a9f0e96-f252-466d-90bb-f71544c05bba tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:03.440635 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.objects.instance [None req-2a9f0e96-f252-466d-90bb-f71544c05bba tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lazy-loading 'fault' on Instance uuid 1b2f404c-1ca9-4904-944c-16685c8f68c5 {{(pid=124824) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:52:03.488592 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-2a9f0e96-f252-466d-90bb-f71544c05bba tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0537911b91184fcdbdcc9e93ec3fe5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad768b45d17480d8d6bbbcff6032c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:03.496641 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-2a9f0e96-f252-466d-90bb-f71544c05bba tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "GET /compute/v2.1/servers/1b2f404c-1ca9-4904-944c-16685c8f68c5" status: 200 len: 1331 microversion: 2.1 time: 0.125604 May 26 12:52:03.497300 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 319/646] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:52:03 2022] GET /compute/v2.1/servers/1b2f404c-1ca9-4904-944c-16685c8f68c5 => generated 1331 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:52:04.431381 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-cb09fd8f-d66c-4134-bc6e-fc353585c65b tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:04.431991 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-cb09fd8f-d66c-4134-bc6e-fc353585c65b tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 73592c9c-6dae-4521-a03d-e02749530cac] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:04.439388 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-cb09fd8f-d66c-4134-bc6e-fc353585c65b tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:04.439838 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-cb09fd8f-d66c-4134-bc6e-fc353585c65b tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:04.440600 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-cb09fd8f-d66c-4134-bc6e-fc353585c65b tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:04.441030 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-cb09fd8f-d66c-4134-bc6e-fc353585c65b tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:04.518783 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-475980a7-5af9-49fb-b05c-07fcef4f1c24 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:04.519502 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-475980a7-5af9-49fb-b05c-07fcef4f1c24 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: 1b2f404c-1ca9-4904-944c-16685c8f68c5] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:04.538354 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-475980a7-5af9-49fb-b05c-07fcef4f1c24 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:04.538811 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-475980a7-5af9-49fb-b05c-07fcef4f1c24 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:04.540055 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-475980a7-5af9-49fb-b05c-07fcef4f1c24 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:04.540448 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-475980a7-5af9-49fb-b05c-07fcef4f1c24 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:04.557178 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.wsgi [None req-475980a7-5af9-49fb-b05c-07fcef4f1c24 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] HTTP exception thrown: Instance 1b2f404c-1ca9-4904-944c-16685c8f68c5 could not be found. May 26 12:52:04.558900 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-475980a7-5af9-49fb-b05c-07fcef4f1c24 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Request method failure captured: May 26 12:52:04.558900 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: request: GET /compute/v2.1/servers/1b2f404c-1ca9-4904-944c-16685c8f68c5 HTTP/1.1 May 26 12:52:04.558900 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Accept: application/json May 26 12:52:04.558900 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Accept-Encoding: identity May 26 12:52:04.558900 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Connection: close May 26 12:52:04.558900 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Content-Length: 0 May 26 12:52:04.558900 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Content-Type: application/json May 26 12:52:04.558900 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Host: 10.222.0.41 May 26 12:52:04.558900 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Openstack-System-Scope: None May 26 12:52:04.558900 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: User-Agent: python-urllib3/1.26.9 May 26 12:52:04.558900 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Auth-Token: gAAAAABij3aYTDT6d91IIen8MNgNrsA0ohBGn_dUC2tsponOFwNurwjlknBmFB36blSobobmDRibGa26en17LZfjuhgOSZiQsswJxea6OZWaEAKHfDkIbtu7XpKpGW-ZBZHCz2dZb9rYCBos_UyGkZJY7k8n757Ijkdz5EguRL9a0MDFor49yAU May 26 12:52:04.558900 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Domain-Id: None May 26 12:52:04.558900 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Domain-Name: None May 26 12:52:04.558900 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Identity-Status: Confirmed May 26 12:52:04.558900 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Is-Admin-Project: True May 26 12:52:04.558900 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Domain-Id: default May 26 12:52:04.558900 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Domain-Name: Default May 26 12:52:04.558900 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Id: cad768b45d17480d8d6bbbcff6032c8d May 26 12:52:04.558900 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Name: tempest-AttachVolumeNegativeTest-155076248 May 26 12:52:04.558900 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Role: member,reader May 26 12:52:04.558900 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Roles: member,reader May 26 12:52:04.560672 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/cad768b45d17480d8d6bbbcff6032c8d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/cad768b45d17480d8d6bbbcff6032c8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/cad768b45d17480d8d6bbbcff6032c8d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_cad768b45d17480d8d6bbbcff6032c8d", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 26 12:52:04.560672 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Tenant: tempest-AttachVolumeNegativeTest-155076248 May 26 12:52:04.560672 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Tenant-Id: cad768b45d17480d8d6bbbcff6032c8d May 26 12:52:04.560672 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-155076248 May 26 12:52:04.560672 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User: tempest-AttachVolumeNegativeTest-155076248-project May 26 12:52:04.560672 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Domain-Id: default May 26 12:52:04.560672 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Domain-Name: Default May 26 12:52:04.560672 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Id: 0537911b91184fcdbdcc9e93ec3fe5b9 May 26 12:52:04.560672 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Name: tempest-AttachVolumeNegativeTest-155076248-project May 26 12:52:04.560672 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: method: > May 26 12:52:04.560672 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: exception: Instance 1b2f404c-1ca9-4904-944c-16685c8f68c5 could not be found. May 26 12:52:04.560672 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: action_args: {'id': '1b2f404c-1ca9-4904-944c-16685c8f68c5'} May 26 12:52:04.565010 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:52:04.565010 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:52:04.565010 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:52:04.565010 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:52:04.565010 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:52:04.565010 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:52:04.565010 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:52:04.565010 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:52:04.565010 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:52:04.565010 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:52:04.565010 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b2f404c-1ca9-4904-944c-16685c8f68c5 could not be found. May 26 12:52:04.565010 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:52:04.565010 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:52:04.565010 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:52:04.565010 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:52:04.565010 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:52:04.565010 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:52:04.565010 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:52:04.565010 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:52:04.565010 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:52:04.566326 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:52:04.566326 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 12:52:04.566326 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 12:52:04.566326 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:52:04.566326 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:52:04.566326 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:52:04.566326 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:52:04.566326 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b2f404c-1ca9-4904-944c-16685c8f68c5 could not be found. May 26 12:52:04.566326 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:52:04.566326 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:52:04.566326 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:52:04.566326 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:52:04.566326 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:52:04.566326 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:52:04.566326 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:52:04.566326 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:52:04.566326 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b2f404c-1ca9-4904-944c-16685c8f68c5 could not be found. May 26 12:52:04.566326 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:52:04.567469 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-475980a7-5af9-49fb-b05c-07fcef4f1c24 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Returning 404 to user: Instance 1b2f404c-1ca9-4904-944c-16685c8f68c5 could not be found. {{(pid=124824) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:52:04.567469 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-475980a7-5af9-49fb-b05c-07fcef4f1c24 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "GET /compute/v2.1/servers/1b2f404c-1ca9-4904-944c-16685c8f68c5" status: 404 len: 111 microversion: 2.1 time: 0.047526 May 26 12:52:04.567469 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 320/647] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:52:04 2022] GET /compute/v2.1/servers/1b2f404c-1ca9-4904-944c-16685c8f68c5 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:52:04.573153 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-c71e070c-4b2c-4f2c-81ce-7cb2a0f228a5 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '.version_select at 0x7f26a1d898b0>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:04.585302 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-cb09fd8f-d66c-4134-bc6e-fc353585c65b tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:04.594204 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-cb09fd8f-d66c-4134-bc6e-fc353585c65b tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:04.595809 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-cb09fd8f-d66c-4134-bc6e-fc353585c65b tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:04.601824 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-cb09fd8f-d66c-4134-bc6e-fc353585c65b tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac" status: 200 len: 1725 microversion: 2.20 time: 0.169581 May 26 12:52:04.601824 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 328/648] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:52:04 2022] GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac => generated 1725 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:52:04.653048 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-c71e070c-4b2c-4f2c-81ce-7cb2a0f228a5 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1597628760" status: 202 len: 0 microversion: 2.1 time: 0.083408 May 26 12:52:04.653873 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 321/649] 10.222.0.41 () {58 vars in 1220 bytes} [Thu May 26 12:52:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1597628760 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 26 12:52:05.440667 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-263b75fc-0089-4296-a1d4-730583b4cb21 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Action: 'create', calling method: .version_select at 0x7f26a1d910d0>, body: {"keypair": {"name": "tempest-keypair-1542808163", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHunvW7gjrXHC1FAwKRlfP40L361Wy1w1JMOgjHH5vNQyXp4iuoCPDA9hVzykBfMR40q0kTwrca4k0+TFZJWLsNTPzjseOLY6zPRTOyxV0Fg7vYbYQ/w/gQuaRtRxvSKaQ=="}} {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:52:05.455799 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.quota [None req-263b75fc-0089-4296-a1d4-730583b4cb21 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Getting quotas for project cad768b45d17480d8d6bbbcff6032c8d. Resources: {'key_pairs'} {{(pid=124823) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:52:05.459595 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.quota [None req-263b75fc-0089-4296-a1d4-730583b4cb21 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Getting quotas for user 0537911b91184fcdbdcc9e93ec3fe5b9 and project cad768b45d17480d8d6bbbcff6032c8d. Resources: {'key_pairs'} {{(pid=124823) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:52:05.562130 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-263b75fc-0089-4296-a1d4-730583b4cb21 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.125180 May 26 12:52:05.562736 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 329/650] 10.222.0.41 () {60 vars in 1158 bytes} [Thu May 26 12:52:05 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:52:05.618824 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-5bfe3f6f-44a4-4f71-825f-d7241f1f5be9 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:05.619446 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-5bfe3f6f-44a4-4f71-825f-d7241f1f5be9 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 73592c9c-6dae-4521-a03d-e02749530cac] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:05.627386 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-5bfe3f6f-44a4-4f71-825f-d7241f1f5be9 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:05.627840 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-5bfe3f6f-44a4-4f71-825f-d7241f1f5be9 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:05.628876 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-5bfe3f6f-44a4-4f71-825f-d7241f1f5be9 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:05.629341 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-5bfe3f6f-44a4-4f71-825f-d7241f1f5be9 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:05.916304 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-5bfe3f6f-44a4-4f71-825f-d7241f1f5be9 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:05.925364 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-5bfe3f6f-44a4-4f71-825f-d7241f1f5be9 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:05.926922 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-5bfe3f6f-44a4-4f71-825f-d7241f1f5be9 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:05.928317 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-5bfe3f6f-44a4-4f71-825f-d7241f1f5be9 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac" status: 200 len: 1725 microversion: 2.20 time: 0.313335 May 26 12:52:05.939621 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 322/651] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:52:05 2022] GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac => generated 1725 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:52:06.947314 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-1f20903d-0a07-4d0d-b5a5-551a59e0ecd3 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:06.948597 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-1f20903d-0a07-4d0d-b5a5-551a59e0ecd3 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 73592c9c-6dae-4521-a03d-e02749530cac] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:06.955978 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-1f20903d-0a07-4d0d-b5a5-551a59e0ecd3 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:06.956505 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-1f20903d-0a07-4d0d-b5a5-551a59e0ecd3 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:06.957342 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-1f20903d-0a07-4d0d-b5a5-551a59e0ecd3 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:06.957811 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-1f20903d-0a07-4d0d-b5a5-551a59e0ecd3 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:07.108042 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-1f20903d-0a07-4d0d-b5a5-551a59e0ecd3 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:07.118645 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-1f20903d-0a07-4d0d-b5a5-551a59e0ecd3 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:07.120328 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-1f20903d-0a07-4d0d-b5a5-551a59e0ecd3 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:07.121572 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-1f20903d-0a07-4d0d-b5a5-551a59e0ecd3 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac" status: 200 len: 1725 microversion: 2.20 time: 0.178282 May 26 12:52:07.122400 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 330/652] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:52:06 2022] GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac => generated 1725 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:52:08.143194 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-811f9a92-91d1-4486-aa9a-1f50efc86d28 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:08.143787 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-811f9a92-91d1-4486-aa9a-1f50efc86d28 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 73592c9c-6dae-4521-a03d-e02749530cac] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:08.150448 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-811f9a92-91d1-4486-aa9a-1f50efc86d28 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:08.151196 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-811f9a92-91d1-4486-aa9a-1f50efc86d28 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:08.151633 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-811f9a92-91d1-4486-aa9a-1f50efc86d28 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:08.152066 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-811f9a92-91d1-4486-aa9a-1f50efc86d28 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:08.356849 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-811f9a92-91d1-4486-aa9a-1f50efc86d28 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:08.365411 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-811f9a92-91d1-4486-aa9a-1f50efc86d28 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:08.403595 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-811f9a92-91d1-4486-aa9a-1f50efc86d28 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:08.403595 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-811f9a92-91d1-4486-aa9a-1f50efc86d28 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac" status: 200 len: 1725 microversion: 2.20 time: 0.229474 May 26 12:52:08.403595 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 323/653] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:52:08 2022] GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac => generated 1725 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:52:08.534835 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-269d57f4-f06e-448a-b198-83421315c68b tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-162474483", "imageRef": "6df25342-b071-489b-a7c1-3089fa19af6d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fd8eb981-0241-4288-8206-05bf49eea8ea"}], "security_groups": [{"name": "tempest-securitygroup--2102164050"}], "key_name": "tempest-keypair-1542808163", "user_data": "}} {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:52:08.668043 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.network.neutron [None req-269d57f4-f06e-448a-b198-83421315c68b tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] validate_networks() for [('fd8eb981-0241-4288-8206-05bf49eea8ea', None, None, None, None, None)] {{(pid=124823) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 12:52:09.099903 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.virt.hardware [None req-269d57f4-f06e-448a-b198-83421315c68b tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Flavor limits 0:0:0 {{(pid=124823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 12:52:09.100450 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.virt.hardware [None req-269d57f4-f06e-448a-b198-83421315c68b tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Image limits 0:0:0 {{(pid=124823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 12:52:09.104052 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.virt.hardware [None req-269d57f4-f06e-448a-b198-83421315c68b tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Flavor pref 0:0:0 {{(pid=124823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 12:52:09.104052 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.virt.hardware [None req-269d57f4-f06e-448a-b198-83421315c68b tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Image pref 0:0:0 {{(pid=124823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 12:52:09.104052 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.virt.hardware [None req-269d57f4-f06e-448a-b198-83421315c68b tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 12:52:09.111406 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-269d57f4-f06e-448a-b198-83421315c68b tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:09.111932 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-269d57f4-f06e-448a-b198-83421315c68b tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:09.112794 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-269d57f4-f06e-448a-b198-83421315c68b tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:09.113329 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-269d57f4-f06e-448a-b198-83421315c68b tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:09.130320 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.quota [None req-269d57f4-f06e-448a-b198-83421315c68b tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Getting quotas for project cad768b45d17480d8d6bbbcff6032c8d. Resources: {'instances', 'ram', 'cores'} {{(pid=124823) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:52:09.134354 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.quota [None req-269d57f4-f06e-448a-b198-83421315c68b tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Getting quotas for user 0537911b91184fcdbdcc9e93ec3fe5b9 and project cad768b45d17480d8d6bbbcff6032c8d. Resources: {'instances', 'ram', 'cores'} {{(pid=124823) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:52:09.145583 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-269d57f4-f06e-448a-b198-83421315c68b tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Going to run 1 instances... {{(pid=124823) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 12:52:09.149917 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-269d57f4-f06e-448a-b198-83421315c68b tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: 77ecf3b8-40c2-4eff-ac61-fca2cedc1446] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6df25342-b071-489b-a7c1-3089fa19af6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124823) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 12:52:09.280380 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-269d57f4-f06e-448a-b198-83421315c68b tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.750772 May 26 12:52:09.281411 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 331/654] 10.222.0.41 () {60 vars in 1146 bytes} [Thu May 26 12:52:08 2022] POST /compute/v2.1/servers => generated 402 bytes in 753 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 12:52:09.291569 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-1a668eb5-ff9f-4b2c-8ec2-0ffc3d074772 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:09.292187 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-1a668eb5-ff9f-4b2c-8ec2-0ffc3d074772 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: 77ecf3b8-40c2-4eff-ac61-fca2cedc1446] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:09.359205 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-1a668eb5-ff9f-4b2c-8ec2-0ffc3d074772 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0537911b91184fcdbdcc9e93ec3fe5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad768b45d17480d8d6bbbcff6032c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:09.370386 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-1a668eb5-ff9f-4b2c-8ec2-0ffc3d074772 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "GET /compute/v2.1/servers/77ecf3b8-40c2-4eff-ac61-fca2cedc1446" status: 200 len: 1241 microversion: 2.1 time: 0.079869 May 26 12:52:09.379711 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 324/655] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:52:09 2022] GET /compute/v2.1/servers/77ecf3b8-40c2-4eff-ac61-fca2cedc1446 => generated 1241 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:52:09.420403 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-c0be9467-cbef-403c-a3d8-52313f3055fe tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:09.420942 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-c0be9467-cbef-403c-a3d8-52313f3055fe tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 73592c9c-6dae-4521-a03d-e02749530cac] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:09.432958 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-c0be9467-cbef-403c-a3d8-52313f3055fe tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:09.434689 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-c0be9467-cbef-403c-a3d8-52313f3055fe tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:09.435686 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-c0be9467-cbef-403c-a3d8-52313f3055fe tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:09.436233 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-c0be9467-cbef-403c-a3d8-52313f3055fe tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:09.573726 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-c0be9467-cbef-403c-a3d8-52313f3055fe tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:09.583842 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-c0be9467-cbef-403c-a3d8-52313f3055fe tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:09.585302 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-c0be9467-cbef-403c-a3d8-52313f3055fe tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:09.586796 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-c0be9467-cbef-403c-a3d8-52313f3055fe tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac" status: 200 len: 1725 microversion: 2.20 time: 0.170480 May 26 12:52:09.587259 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 332/656] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:52:09 2022] GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac => generated 1725 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:52:10.386467 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-409d0d42-89b1-4b0d-8483-6f387448c12f tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:10.387199 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-409d0d42-89b1-4b0d-8483-6f387448c12f tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: 77ecf3b8-40c2-4eff-ac61-fca2cedc1446] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:10.394628 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-409d0d42-89b1-4b0d-8483-6f387448c12f tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:10.395154 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-409d0d42-89b1-4b0d-8483-6f387448c12f tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:10.396018 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-409d0d42-89b1-4b0d-8483-6f387448c12f tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:10.396679 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-409d0d42-89b1-4b0d-8483-6f387448c12f tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:10.462825 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-409d0d42-89b1-4b0d-8483-6f387448c12f tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0537911b91184fcdbdcc9e93ec3fe5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad768b45d17480d8d6bbbcff6032c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:10.470955 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-409d0d42-89b1-4b0d-8483-6f387448c12f tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "GET /compute/v2.1/servers/77ecf3b8-40c2-4eff-ac61-fca2cedc1446" status: 200 len: 1245 microversion: 2.1 time: 0.088406 May 26 12:52:10.475990 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 325/657] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:52:10 2022] GET /compute/v2.1/servers/77ecf3b8-40c2-4eff-ac61-fca2cedc1446 => generated 1245 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:52:10.605581 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-c7767b36-addd-4eb9-9d62-47d536e98935 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:10.606217 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-c7767b36-addd-4eb9-9d62-47d536e98935 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 73592c9c-6dae-4521-a03d-e02749530cac] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:10.613480 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-c7767b36-addd-4eb9-9d62-47d536e98935 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:10.613960 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-c7767b36-addd-4eb9-9d62-47d536e98935 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:10.614726 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-c7767b36-addd-4eb9-9d62-47d536e98935 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:10.615161 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-c7767b36-addd-4eb9-9d62-47d536e98935 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:10.771736 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-c7767b36-addd-4eb9-9d62-47d536e98935 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:10.785747 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-c7767b36-addd-4eb9-9d62-47d536e98935 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:10.785747 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-c7767b36-addd-4eb9-9d62-47d536e98935 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:10.785747 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-c7767b36-addd-4eb9-9d62-47d536e98935 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac" status: 200 len: 1725 microversion: 2.20 time: 0.181875 May 26 12:52:10.786789 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 333/658] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:52:10 2022] GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac => generated 1725 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:52:11.489309 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-7b94fe77-bb92-439c-afb3-d6ff9dda6be5 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:11.493550 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-7b94fe77-bb92-439c-afb3-d6ff9dda6be5 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: 77ecf3b8-40c2-4eff-ac61-fca2cedc1446] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:11.498772 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-7b94fe77-bb92-439c-afb3-d6ff9dda6be5 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:11.499932 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-7b94fe77-bb92-439c-afb3-d6ff9dda6be5 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:11.500901 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-7b94fe77-bb92-439c-afb3-d6ff9dda6be5 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:11.501338 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-7b94fe77-bb92-439c-afb3-d6ff9dda6be5 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:11.584502 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-7b94fe77-bb92-439c-afb3-d6ff9dda6be5 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0537911b91184fcdbdcc9e93ec3fe5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad768b45d17480d8d6bbbcff6032c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:11.593252 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-7b94fe77-bb92-439c-afb3-d6ff9dda6be5 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "GET /compute/v2.1/servers/77ecf3b8-40c2-4eff-ac61-fca2cedc1446" status: 200 len: 1301 microversion: 2.1 time: 0.108031 May 26 12:52:11.594608 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 326/659] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:52:11 2022] GET /compute/v2.1/servers/77ecf3b8-40c2-4eff-ac61-fca2cedc1446 => generated 1301 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:52:11.802347 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-da30bb0f-6ce9-41cb-bf15-7c481cbcc34f tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:11.802966 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-da30bb0f-6ce9-41cb-bf15-7c481cbcc34f tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 73592c9c-6dae-4521-a03d-e02749530cac] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:11.809897 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-da30bb0f-6ce9-41cb-bf15-7c481cbcc34f tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:11.810200 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-da30bb0f-6ce9-41cb-bf15-7c481cbcc34f tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:11.811628 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-da30bb0f-6ce9-41cb-bf15-7c481cbcc34f tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:11.812105 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-da30bb0f-6ce9-41cb-bf15-7c481cbcc34f tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:12.019845 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-da30bb0f-6ce9-41cb-bf15-7c481cbcc34f tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:12.028426 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-da30bb0f-6ce9-41cb-bf15-7c481cbcc34f tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:12.030944 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-da30bb0f-6ce9-41cb-bf15-7c481cbcc34f tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:12.032236 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-da30bb0f-6ce9-41cb-bf15-7c481cbcc34f tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac" status: 200 len: 1725 microversion: 2.20 time: 0.233907 May 26 12:52:12.032940 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 334/660] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:52:11 2022] GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac => generated 1725 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:52:12.615404 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-c61d1b39-f8d4-4a1a-8f2f-1e8fae38d9e7 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:12.621417 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-c61d1b39-f8d4-4a1a-8f2f-1e8fae38d9e7 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: 77ecf3b8-40c2-4eff-ac61-fca2cedc1446] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:12.628328 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-c61d1b39-f8d4-4a1a-8f2f-1e8fae38d9e7 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:12.628767 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-c61d1b39-f8d4-4a1a-8f2f-1e8fae38d9e7 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:12.629546 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-c61d1b39-f8d4-4a1a-8f2f-1e8fae38d9e7 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:12.630609 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-c61d1b39-f8d4-4a1a-8f2f-1e8fae38d9e7 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:12.867627 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-c61d1b39-f8d4-4a1a-8f2f-1e8fae38d9e7 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0537911b91184fcdbdcc9e93ec3fe5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad768b45d17480d8d6bbbcff6032c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:12.875621 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-c61d1b39-f8d4-4a1a-8f2f-1e8fae38d9e7 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "GET /compute/v2.1/servers/77ecf3b8-40c2-4eff-ac61-fca2cedc1446" status: 200 len: 1367 microversion: 2.1 time: 0.264110 May 26 12:52:12.876282 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 327/661] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:52:12 2022] GET /compute/v2.1/servers/77ecf3b8-40c2-4eff-ac61-fca2cedc1446 => generated 1367 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:52:13.052974 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-2ad37209-2b07-43b3-9ac6-ebf37bf1f7f8 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:13.053875 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-2ad37209-2b07-43b3-9ac6-ebf37bf1f7f8 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 73592c9c-6dae-4521-a03d-e02749530cac] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:13.062089 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-2ad37209-2b07-43b3-9ac6-ebf37bf1f7f8 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:13.062551 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-2ad37209-2b07-43b3-9ac6-ebf37bf1f7f8 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:13.063386 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-2ad37209-2b07-43b3-9ac6-ebf37bf1f7f8 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:13.063888 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-2ad37209-2b07-43b3-9ac6-ebf37bf1f7f8 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:13.229884 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-2ad37209-2b07-43b3-9ac6-ebf37bf1f7f8 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:13.246473 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-2ad37209-2b07-43b3-9ac6-ebf37bf1f7f8 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:13.248633 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-2ad37209-2b07-43b3-9ac6-ebf37bf1f7f8 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:13.269428 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-2ad37209-2b07-43b3-9ac6-ebf37bf1f7f8 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac" status: 200 len: 1725 microversion: 2.20 time: 0.202176 May 26 12:52:13.269428 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 335/662] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:52:13 2022] GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac => generated 1725 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:52:13.454493 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [req-8d8eb5c9-3fe3-4e1d-ace6-8d4a2c6e2a27 req-27c83289-b033-4f87-b713-63cb7f8e9f89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77ecf3b8-40c2-4eff-ac61-fca2cedc1446", "tag": "0a37403c-8949-4ad9-9963-4bc69e1e8094"}]} {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:52:13.466450 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [req-8d8eb5c9-3fe3-4e1d-ace6-8d4a2c6e2a27 req-27c83289-b033-4f87-b713-63cb7f8e9f89 service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:13.467620 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [req-8d8eb5c9-3fe3-4e1d-ace6-8d4a2c6e2a27 req-27c83289-b033-4f87-b713-63cb7f8e9f89 service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:13.508304 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.compute.server_external_events [req-8d8eb5c9-3fe3-4e1d-ace6-8d4a2c6e2a27 req-27c83289-b033-4f87-b713-63cb7f8e9f89 service nova] Creating event network-changed:0a37403c-8949-4ad9-9963-4bc69e1e8094 for instance 77ecf3b8-40c2-4eff-ac61-fca2cedc1446 on hv-cinder-81571 May 26 12:52:13.514238 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [req-8d8eb5c9-3fe3-4e1d-ace6-8d4a2c6e2a27 req-27c83289-b033-4f87-b713-63cb7f8e9f89 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063230 May 26 12:52:13.517963 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 328/663] 10.222.0.41 () {64 vars in 1317 bytes} [Thu May 26 12:52:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:52:13.894284 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-0f517780-3791-4cfe-8ed9-bb592f9afbae tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:13.899072 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-0f517780-3791-4cfe-8ed9-bb592f9afbae tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: 77ecf3b8-40c2-4eff-ac61-fca2cedc1446] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:13.901301 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-0f517780-3791-4cfe-8ed9-bb592f9afbae tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:13.901792 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-0f517780-3791-4cfe-8ed9-bb592f9afbae tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:13.902571 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-0f517780-3791-4cfe-8ed9-bb592f9afbae tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:13.903108 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-0f517780-3791-4cfe-8ed9-bb592f9afbae tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:14.072126 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-0f517780-3791-4cfe-8ed9-bb592f9afbae tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0537911b91184fcdbdcc9e93ec3fe5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad768b45d17480d8d6bbbcff6032c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:14.082232 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-0f517780-3791-4cfe-8ed9-bb592f9afbae tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "GET /compute/v2.1/servers/77ecf3b8-40c2-4eff-ac61-fca2cedc1446" status: 200 len: 1367 microversion: 2.1 time: 0.193619 May 26 12:52:14.082819 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 336/664] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:52:13 2022] GET /compute/v2.1/servers/77ecf3b8-40c2-4eff-ac61-fca2cedc1446 => generated 1367 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:52:14.277694 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-43e925f0-f9d0-4418-893b-3b9885ccedd6 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:14.278434 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-43e925f0-f9d0-4418-893b-3b9885ccedd6 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 73592c9c-6dae-4521-a03d-e02749530cac] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:14.285106 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-43e925f0-f9d0-4418-893b-3b9885ccedd6 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:14.285567 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-43e925f0-f9d0-4418-893b-3b9885ccedd6 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:14.286347 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-43e925f0-f9d0-4418-893b-3b9885ccedd6 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:14.286775 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-43e925f0-f9d0-4418-893b-3b9885ccedd6 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:14.420422 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-43e925f0-f9d0-4418-893b-3b9885ccedd6 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:14.428375 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-43e925f0-f9d0-4418-893b-3b9885ccedd6 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:14.429825 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-43e925f0-f9d0-4418-893b-3b9885ccedd6 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:14.430984 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-43e925f0-f9d0-4418-893b-3b9885ccedd6 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac" status: 200 len: 1746 microversion: 2.20 time: 0.158242 May 26 12:52:14.431546 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 329/665] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:52:14 2022] GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac => generated 1746 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:52:15.111952 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-1dc9c6f9-f010-4e3f-8019-711abdc9f07d tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:15.112592 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-1dc9c6f9-f010-4e3f-8019-711abdc9f07d tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: 77ecf3b8-40c2-4eff-ac61-fca2cedc1446] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:15.119229 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-1dc9c6f9-f010-4e3f-8019-711abdc9f07d tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:15.119676 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-1dc9c6f9-f010-4e3f-8019-711abdc9f07d tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:15.122995 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-1dc9c6f9-f010-4e3f-8019-711abdc9f07d tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:15.122995 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-1dc9c6f9-f010-4e3f-8019-711abdc9f07d tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:15.249201 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-1dc9c6f9-f010-4e3f-8019-711abdc9f07d tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0537911b91184fcdbdcc9e93ec3fe5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad768b45d17480d8d6bbbcff6032c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:15.255795 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-1dc9c6f9-f010-4e3f-8019-711abdc9f07d tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "GET /compute/v2.1/servers/77ecf3b8-40c2-4eff-ac61-fca2cedc1446" status: 200 len: 1367 microversion: 2.1 time: 0.148470 May 26 12:52:15.256375 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 337/666] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:52:15 2022] GET /compute/v2.1/servers/77ecf3b8-40c2-4eff-ac61-fca2cedc1446 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:52:15.451532 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-e5bd22a6-fc5b-440f-a23c-5cf39e973016 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:15.452283 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-e5bd22a6-fc5b-440f-a23c-5cf39e973016 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 73592c9c-6dae-4521-a03d-e02749530cac] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:15.459123 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-e5bd22a6-fc5b-440f-a23c-5cf39e973016 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:15.459581 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-e5bd22a6-fc5b-440f-a23c-5cf39e973016 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:15.460481 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-e5bd22a6-fc5b-440f-a23c-5cf39e973016 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:15.460917 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-e5bd22a6-fc5b-440f-a23c-5cf39e973016 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:15.597301 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-e5bd22a6-fc5b-440f-a23c-5cf39e973016 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:15.606092 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-e5bd22a6-fc5b-440f-a23c-5cf39e973016 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:15.607651 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-e5bd22a6-fc5b-440f-a23c-5cf39e973016 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:15.608812 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-e5bd22a6-fc5b-440f-a23c-5cf39e973016 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac" status: 200 len: 1746 microversion: 2.20 time: 0.162323 May 26 12:52:15.610337 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 330/667] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:52:15 2022] GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac => generated 1746 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:52:16.272643 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-44ff1192-2e70-493f-8fa9-d234a283fe4d tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:16.273363 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-44ff1192-2e70-493f-8fa9-d234a283fe4d tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: 77ecf3b8-40c2-4eff-ac61-fca2cedc1446] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:16.280534 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-44ff1192-2e70-493f-8fa9-d234a283fe4d tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:16.280972 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-44ff1192-2e70-493f-8fa9-d234a283fe4d tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:16.281744 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-44ff1192-2e70-493f-8fa9-d234a283fe4d tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:16.282176 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-44ff1192-2e70-493f-8fa9-d234a283fe4d tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:16.426000 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-44ff1192-2e70-493f-8fa9-d234a283fe4d tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0537911b91184fcdbdcc9e93ec3fe5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad768b45d17480d8d6bbbcff6032c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:16.433514 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-44ff1192-2e70-493f-8fa9-d234a283fe4d tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "GET /compute/v2.1/servers/77ecf3b8-40c2-4eff-ac61-fca2cedc1446" status: 200 len: 1367 microversion: 2.1 time: 0.164739 May 26 12:52:16.434119 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 338/668] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:52:16 2022] GET /compute/v2.1/servers/77ecf3b8-40c2-4eff-ac61-fca2cedc1446 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:52:16.627500 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-000453e6-93f0-47bb-a8b0-358b2ea4f7e8 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:16.628105 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-000453e6-93f0-47bb-a8b0-358b2ea4f7e8 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 73592c9c-6dae-4521-a03d-e02749530cac] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:16.635105 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-000453e6-93f0-47bb-a8b0-358b2ea4f7e8 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:16.635541 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-000453e6-93f0-47bb-a8b0-358b2ea4f7e8 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:16.636298 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-000453e6-93f0-47bb-a8b0-358b2ea4f7e8 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:16.636733 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-000453e6-93f0-47bb-a8b0-358b2ea4f7e8 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:16.770830 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-000453e6-93f0-47bb-a8b0-358b2ea4f7e8 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:16.781608 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-000453e6-93f0-47bb-a8b0-358b2ea4f7e8 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:16.783693 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-000453e6-93f0-47bb-a8b0-358b2ea4f7e8 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:16.785049 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-000453e6-93f0-47bb-a8b0-358b2ea4f7e8 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac" status: 200 len: 1741 microversion: 2.20 time: 0.161970 May 26 12:52:16.785750 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 331/669] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:52:16 2022] GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac => generated 1741 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:52:17.450771 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-ab80d747-d68f-4db1-9d31-da3be102e8bc tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:17.452721 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-ab80d747-d68f-4db1-9d31-da3be102e8bc tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: 77ecf3b8-40c2-4eff-ac61-fca2cedc1446] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:17.459698 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-ab80d747-d68f-4db1-9d31-da3be102e8bc tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:17.460259 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-ab80d747-d68f-4db1-9d31-da3be102e8bc tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:17.461292 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-ab80d747-d68f-4db1-9d31-da3be102e8bc tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:17.461992 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-ab80d747-d68f-4db1-9d31-da3be102e8bc tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:17.620786 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-ab80d747-d68f-4db1-9d31-da3be102e8bc tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0537911b91184fcdbdcc9e93ec3fe5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad768b45d17480d8d6bbbcff6032c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:17.625241 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG dbcounter [-] [124823] Writing DB stats nova_cell1:SELECT=100 {{(pid=124823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:52:17.634264 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-ab80d747-d68f-4db1-9d31-da3be102e8bc tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "GET /compute/v2.1/servers/77ecf3b8-40c2-4eff-ac61-fca2cedc1446" status: 200 len: 1367 microversion: 2.1 time: 0.187289 May 26 12:52:17.638524 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 339/670] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:52:17 2022] GET /compute/v2.1/servers/77ecf3b8-40c2-4eff-ac61-fca2cedc1446 => generated 1367 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:52:17.808297 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-58dccdd1-9a6a-486f-91ea-5128d432bbfa tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:17.808877 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-58dccdd1-9a6a-486f-91ea-5128d432bbfa tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 73592c9c-6dae-4521-a03d-e02749530cac] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:17.817510 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-58dccdd1-9a6a-486f-91ea-5128d432bbfa tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:17.818780 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-58dccdd1-9a6a-486f-91ea-5128d432bbfa tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:17.820371 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-58dccdd1-9a6a-486f-91ea-5128d432bbfa tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:17.821007 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-58dccdd1-9a6a-486f-91ea-5128d432bbfa tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:18.044081 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-58dccdd1-9a6a-486f-91ea-5128d432bbfa tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:18.061132 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-58dccdd1-9a6a-486f-91ea-5128d432bbfa tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:18.063215 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-58dccdd1-9a6a-486f-91ea-5128d432bbfa tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:18.065349 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-58dccdd1-9a6a-486f-91ea-5128d432bbfa tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac" status: 200 len: 1741 microversion: 2.20 time: 0.264653 May 26 12:52:18.066959 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 332/671] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:52:17 2022] GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac => generated 1741 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:52:18.131716 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [req-46dd4cdb-cf9c-4530-b466-55a36f2aadd3 req-30552203-c812-4588-bde2-d77526c0908a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73592c9c-6dae-4521-a03d-e02749530cac", "name": "network-vif-plugged", "status": "completed", "tag": "d2fc86c7-8d2d-4221-a19f-e4847de64091"}]} {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:52:18.143163 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [req-46dd4cdb-cf9c-4530-b466-55a36f2aadd3 req-30552203-c812-4588-bde2-d77526c0908a service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:18.148338 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [req-46dd4cdb-cf9c-4530-b466-55a36f2aadd3 req-30552203-c812-4588-bde2-d77526c0908a service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:18.164161 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.compute.server_external_events [req-46dd4cdb-cf9c-4530-b466-55a36f2aadd3 req-30552203-c812-4588-bde2-d77526c0908a service nova] Creating event network-vif-plugged:d2fc86c7-8d2d-4221-a19f-e4847de64091 for instance 73592c9c-6dae-4521-a03d-e02749530cac on hv-cinder-81571 May 26 12:52:18.171923 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [req-46dd4cdb-cf9c-4530-b466-55a36f2aadd3 req-30552203-c812-4588-bde2-d77526c0908a service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047859 May 26 12:52:18.173326 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 340/672] 10.222.0.41 () {64 vars in 1317 bytes} [Thu May 26 12:52:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:52:18.655324 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-4e090008-16a0-4bd4-bd1c-8270291b8ae1 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:18.657197 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-4e090008-16a0-4bd4-bd1c-8270291b8ae1 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: 77ecf3b8-40c2-4eff-ac61-fca2cedc1446] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:18.668904 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-4e090008-16a0-4bd4-bd1c-8270291b8ae1 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:18.671929 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-4e090008-16a0-4bd4-bd1c-8270291b8ae1 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:18.672729 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-4e090008-16a0-4bd4-bd1c-8270291b8ae1 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:18.676231 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-4e090008-16a0-4bd4-bd1c-8270291b8ae1 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:18.839682 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-4e090008-16a0-4bd4-bd1c-8270291b8ae1 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0537911b91184fcdbdcc9e93ec3fe5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad768b45d17480d8d6bbbcff6032c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:18.848405 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-4e090008-16a0-4bd4-bd1c-8270291b8ae1 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "GET /compute/v2.1/servers/77ecf3b8-40c2-4eff-ac61-fca2cedc1446" status: 200 len: 1367 microversion: 2.1 time: 0.198475 May 26 12:52:18.849244 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 333/673] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:52:18 2022] GET /compute/v2.1/servers/77ecf3b8-40c2-4eff-ac61-fca2cedc1446 => generated 1367 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:52:19.091275 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-09fe23f5-9454-49e2-bb69-c1d44767629e tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:19.095211 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-09fe23f5-9454-49e2-bb69-c1d44767629e tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 73592c9c-6dae-4521-a03d-e02749530cac] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:19.104335 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-09fe23f5-9454-49e2-bb69-c1d44767629e tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:19.105419 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-09fe23f5-9454-49e2-bb69-c1d44767629e tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:19.107372 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-09fe23f5-9454-49e2-bb69-c1d44767629e tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:19.108434 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-09fe23f5-9454-49e2-bb69-c1d44767629e tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:19.132904 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG dbcounter [-] [124823] Writing DB stats nova_cell0:SELECT=2 {{(pid=124823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:52:19.142693 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG dbcounter [-] [124823] Writing DB stats nova_cell0:SELECT=10 {{(pid=124823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:52:19.319990 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-09fe23f5-9454-49e2-bb69-c1d44767629e tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:19.335937 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-09fe23f5-9454-49e2-bb69-c1d44767629e tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:19.337781 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-09fe23f5-9454-49e2-bb69-c1d44767629e tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:19.339349 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-09fe23f5-9454-49e2-bb69-c1d44767629e tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac" status: 200 len: 1741 microversion: 2.20 time: 0.257321 May 26 12:52:19.340101 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 341/674] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:52:19 2022] GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac => generated 1741 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:52:19.867028 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-8626d982-df3d-4b9e-b391-35e7d257c1f5 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:19.869027 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-8626d982-df3d-4b9e-b391-35e7d257c1f5 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: 77ecf3b8-40c2-4eff-ac61-fca2cedc1446] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:19.870652 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG dbcounter [-] [124824] Writing DB stats nova_cell0:SELECT=2 {{(pid=124824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:52:19.877854 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-8626d982-df3d-4b9e-b391-35e7d257c1f5 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:19.878611 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-8626d982-df3d-4b9e-b391-35e7d257c1f5 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:19.879692 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-8626d982-df3d-4b9e-b391-35e7d257c1f5 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:19.880274 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-8626d982-df3d-4b9e-b391-35e7d257c1f5 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:19.885555 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG dbcounter [-] [124824] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:52:20.067626 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-8626d982-df3d-4b9e-b391-35e7d257c1f5 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0537911b91184fcdbdcc9e93ec3fe5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad768b45d17480d8d6bbbcff6032c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:20.083028 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-8626d982-df3d-4b9e-b391-35e7d257c1f5 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "GET /compute/v2.1/servers/77ecf3b8-40c2-4eff-ac61-fca2cedc1446" status: 200 len: 1367 microversion: 2.1 time: 0.220264 May 26 12:52:20.094003 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 334/675] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:52:19 2022] GET /compute/v2.1/servers/77ecf3b8-40c2-4eff-ac61-fca2cedc1446 => generated 1367 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:52:20.192731 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [req-a8084347-e411-467b-bc6d-cbc7172ae808 req-2af93b6b-5d1e-4131-897f-cfee90633f33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77ecf3b8-40c2-4eff-ac61-fca2cedc1446", "name": "network-vif-plugged", "status": "completed", "tag": "0a37403c-8949-4ad9-9963-4bc69e1e8094"}]} {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:52:20.219522 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [req-a8084347-e411-467b-bc6d-cbc7172ae808 req-2af93b6b-5d1e-4131-897f-cfee90633f33 service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:20.221427 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [req-a8084347-e411-467b-bc6d-cbc7172ae808 req-2af93b6b-5d1e-4131-897f-cfee90633f33 service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:20.251255 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.compute.server_external_events [req-a8084347-e411-467b-bc6d-cbc7172ae808 req-2af93b6b-5d1e-4131-897f-cfee90633f33 service nova] Creating event network-vif-plugged:0a37403c-8949-4ad9-9963-4bc69e1e8094 for instance 77ecf3b8-40c2-4eff-ac61-fca2cedc1446 on hv-cinder-81571 May 26 12:52:20.262890 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [req-a8084347-e411-467b-bc6d-cbc7172ae808 req-2af93b6b-5d1e-4131-897f-cfee90633f33 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077126 May 26 12:52:20.267469 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 342/676] 10.222.0.41 () {64 vars in 1317 bytes} [Thu May 26 12:52:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:52:20.360668 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-591d63af-5fff-43a3-a16a-882677c34c90 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:20.361724 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-591d63af-5fff-43a3-a16a-882677c34c90 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 73592c9c-6dae-4521-a03d-e02749530cac] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:20.369380 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-591d63af-5fff-43a3-a16a-882677c34c90 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:20.370303 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-591d63af-5fff-43a3-a16a-882677c34c90 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:20.374472 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-591d63af-5fff-43a3-a16a-882677c34c90 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:20.375226 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-591d63af-5fff-43a3-a16a-882677c34c90 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:20.550945 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-591d63af-5fff-43a3-a16a-882677c34c90 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:20.561897 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-591d63af-5fff-43a3-a16a-882677c34c90 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:20.565478 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-591d63af-5fff-43a3-a16a-882677c34c90 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:20.567298 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-591d63af-5fff-43a3-a16a-882677c34c90 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac" status: 200 len: 1741 microversion: 2.20 time: 0.210748 May 26 12:52:20.568365 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 335/677] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:52:20 2022] GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac => generated 1741 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:52:21.111880 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-fc291482-1ce1-49df-858d-918e21b062f0 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:21.113062 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-fc291482-1ce1-49df-858d-918e21b062f0 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: 77ecf3b8-40c2-4eff-ac61-fca2cedc1446] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:21.123706 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-fc291482-1ce1-49df-858d-918e21b062f0 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:21.130757 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-fc291482-1ce1-49df-858d-918e21b062f0 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:21.130757 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-fc291482-1ce1-49df-858d-918e21b062f0 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:21.130757 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-fc291482-1ce1-49df-858d-918e21b062f0 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:21.283246 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-fc291482-1ce1-49df-858d-918e21b062f0 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0537911b91184fcdbdcc9e93ec3fe5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad768b45d17480d8d6bbbcff6032c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:21.292545 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-fc291482-1ce1-49df-858d-918e21b062f0 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "GET /compute/v2.1/servers/77ecf3b8-40c2-4eff-ac61-fca2cedc1446" status: 200 len: 1367 microversion: 2.1 time: 0.185416 May 26 12:52:21.293382 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 343/678] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:52:21 2022] GET /compute/v2.1/servers/77ecf3b8-40c2-4eff-ac61-fca2cedc1446 => generated 1367 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:52:21.587363 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-a5464587-7c57-4053-b1a9-55c6cb6d8663 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:21.587979 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-a5464587-7c57-4053-b1a9-55c6cb6d8663 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 73592c9c-6dae-4521-a03d-e02749530cac] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:21.595733 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-a5464587-7c57-4053-b1a9-55c6cb6d8663 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:21.596474 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-a5464587-7c57-4053-b1a9-55c6cb6d8663 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:21.599184 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-a5464587-7c57-4053-b1a9-55c6cb6d8663 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:21.600026 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-a5464587-7c57-4053-b1a9-55c6cb6d8663 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:21.791837 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-a5464587-7c57-4053-b1a9-55c6cb6d8663 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:21.802817 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-a5464587-7c57-4053-b1a9-55c6cb6d8663 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:21.804467 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-a5464587-7c57-4053-b1a9-55c6cb6d8663 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:21.805940 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-a5464587-7c57-4053-b1a9-55c6cb6d8663 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac" status: 200 len: 1741 microversion: 2.20 time: 0.222927 May 26 12:52:21.806876 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 336/679] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:52:21 2022] GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac => generated 1741 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:52:22.309984 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-0ad0069a-b044-4fcb-bded-542b3acca8e6 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:22.310835 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-0ad0069a-b044-4fcb-bded-542b3acca8e6 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: 77ecf3b8-40c2-4eff-ac61-fca2cedc1446] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:22.326787 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-0ad0069a-b044-4fcb-bded-542b3acca8e6 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:22.328027 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-0ad0069a-b044-4fcb-bded-542b3acca8e6 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:22.330064 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-0ad0069a-b044-4fcb-bded-542b3acca8e6 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:22.331288 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-0ad0069a-b044-4fcb-bded-542b3acca8e6 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:22.510199 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-0ad0069a-b044-4fcb-bded-542b3acca8e6 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0537911b91184fcdbdcc9e93ec3fe5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad768b45d17480d8d6bbbcff6032c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:22.519413 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-0ad0069a-b044-4fcb-bded-542b3acca8e6 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "GET /compute/v2.1/servers/77ecf3b8-40c2-4eff-ac61-fca2cedc1446" status: 200 len: 1557 microversion: 2.1 time: 0.213846 May 26 12:52:22.520005 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 344/680] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:52:22 2022] GET /compute/v2.1/servers/77ecf3b8-40c2-4eff-ac61-fca2cedc1446 => generated 1557 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:52:22.547023 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-a9ddda41-9f73-4742-a3f7-80561bc275ce tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:22.547734 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-a9ddda41-9f73-4742-a3f7-80561bc275ce tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: 77ecf3b8-40c2-4eff-ac61-fca2cedc1446] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:22.564727 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-a9ddda41-9f73-4742-a3f7-80561bc275ce tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:22.565262 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-a9ddda41-9f73-4742-a3f7-80561bc275ce tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:22.566258 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-a9ddda41-9f73-4742-a3f7-80561bc275ce tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:22.566768 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-a9ddda41-9f73-4742-a3f7-80561bc275ce tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:22.673072 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-a9ddda41-9f73-4742-a3f7-80561bc275ce tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "GET /compute/v2.1/servers/77ecf3b8-40c2-4eff-ac61-fca2cedc1446/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.132835 May 26 12:52:22.679564 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 337/681] 10.222.0.41 () {58 vars in 1274 bytes} [Thu May 26 12:52:22 2022] GET /compute/v2.1/servers/77ecf3b8-40c2-4eff-ac61-fca2cedc1446/os-interface => generated 285 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:52:22.829253 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-74218935-c925-4396-8945-e937ce87d1b5 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:22.829253 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-74218935-c925-4396-8945-e937ce87d1b5 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 73592c9c-6dae-4521-a03d-e02749530cac] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:22.836591 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-74218935-c925-4396-8945-e937ce87d1b5 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:22.837639 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-74218935-c925-4396-8945-e937ce87d1b5 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:22.838321 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-74218935-c925-4396-8945-e937ce87d1b5 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:22.838953 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-74218935-c925-4396-8945-e937ce87d1b5 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:23.114235 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-74218935-c925-4396-8945-e937ce87d1b5 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:23.124012 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-74218935-c925-4396-8945-e937ce87d1b5 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:23.145936 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-74218935-c925-4396-8945-e937ce87d1b5 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:23.145936 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-74218935-c925-4396-8945-e937ce87d1b5 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac" status: 200 len: 1741 microversion: 2.20 time: 0.303713 May 26 12:52:23.145936 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 345/682] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:52:22 2022] GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac => generated 1741 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:52:24.147452 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-0fcb8b25-ec9f-47da-a712-a5624291df6a tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:24.148087 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-0fcb8b25-ec9f-47da-a712-a5624291df6a tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 73592c9c-6dae-4521-a03d-e02749530cac] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:24.159124 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-0fcb8b25-ec9f-47da-a712-a5624291df6a tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:24.159577 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-0fcb8b25-ec9f-47da-a712-a5624291df6a tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:24.160369 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-0fcb8b25-ec9f-47da-a712-a5624291df6a tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:24.161436 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-0fcb8b25-ec9f-47da-a712-a5624291df6a tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:24.204783 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [req-e0fac1c7-7966-4ba9-a8eb-14d9201c21c8 req-e9da353c-fea8-4c30-a1a3-b9dc8882af29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77ecf3b8-40c2-4eff-ac61-fca2cedc1446", "tag": "0a37403c-8949-4ad9-9963-4bc69e1e8094"}]} {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:52:24.228617 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [req-e0fac1c7-7966-4ba9-a8eb-14d9201c21c8 req-e9da353c-fea8-4c30-a1a3-b9dc8882af29 service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:24.229366 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [req-e0fac1c7-7966-4ba9-a8eb-14d9201c21c8 req-e9da353c-fea8-4c30-a1a3-b9dc8882af29 service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:24.242967 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.compute.server_external_events [req-e0fac1c7-7966-4ba9-a8eb-14d9201c21c8 req-e9da353c-fea8-4c30-a1a3-b9dc8882af29 service nova] Creating event network-changed:0a37403c-8949-4ad9-9963-4bc69e1e8094 for instance 77ecf3b8-40c2-4eff-ac61-fca2cedc1446 on hv-cinder-81571 May 26 12:52:24.248841 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [req-e0fac1c7-7966-4ba9-a8eb-14d9201c21c8 req-e9da353c-fea8-4c30-a1a3-b9dc8882af29 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.264996 May 26 12:52:24.253325 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 338/683] 10.222.0.41 () {64 vars in 1317 bytes} [Thu May 26 12:52:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:52:24.413160 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-0fcb8b25-ec9f-47da-a712-a5624291df6a tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:24.441968 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-0fcb8b25-ec9f-47da-a712-a5624291df6a tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:24.445038 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-0fcb8b25-ec9f-47da-a712-a5624291df6a tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:24.446169 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-0fcb8b25-ec9f-47da-a712-a5624291df6a tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac" status: 200 len: 1741 microversion: 2.20 time: 0.302895 May 26 12:52:24.447222 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 346/684] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:52:24 2022] GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac => generated 1741 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:52:25.475039 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-80e43ceb-4b95-4c4d-b3c1-459cf52098da tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:25.475749 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-80e43ceb-4b95-4c4d-b3c1-459cf52098da tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 73592c9c-6dae-4521-a03d-e02749530cac] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:25.483581 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-80e43ceb-4b95-4c4d-b3c1-459cf52098da tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:25.484273 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-80e43ceb-4b95-4c4d-b3c1-459cf52098da tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:25.485229 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-80e43ceb-4b95-4c4d-b3c1-459cf52098da tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:25.485859 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-80e43ceb-4b95-4c4d-b3c1-459cf52098da tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:25.712461 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-80e43ceb-4b95-4c4d-b3c1-459cf52098da tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:25.723983 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-80e43ceb-4b95-4c4d-b3c1-459cf52098da tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:25.725868 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-80e43ceb-4b95-4c4d-b3c1-459cf52098da tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:25.727263 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-80e43ceb-4b95-4c4d-b3c1-459cf52098da tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac" status: 200 len: 1741 microversion: 2.20 time: 0.257117 May 26 12:52:25.738916 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 339/685] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:52:25 2022] GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac => generated 1741 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:52:26.746778 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-3e3c4999-3ee6-4e48-8288-48318b595a47 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:26.748026 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-3e3c4999-3ee6-4e48-8288-48318b595a47 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 73592c9c-6dae-4521-a03d-e02749530cac] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:26.750688 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG dbcounter [-] [124823] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=4 {{(pid=124823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:52:26.755886 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-3e3c4999-3ee6-4e48-8288-48318b595a47 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:26.756346 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-3e3c4999-3ee6-4e48-8288-48318b595a47 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:26.757361 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-3e3c4999-3ee6-4e48-8288-48318b595a47 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:26.757767 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-3e3c4999-3ee6-4e48-8288-48318b595a47 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:26.903821 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-3e3c4999-3ee6-4e48-8288-48318b595a47 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:26.914057 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-3e3c4999-3ee6-4e48-8288-48318b595a47 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:26.916076 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-3e3c4999-3ee6-4e48-8288-48318b595a47 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:26.917296 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-3e3c4999-3ee6-4e48-8288-48318b595a47 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac" status: 200 len: 1741 microversion: 2.20 time: 0.174788 May 26 12:52:26.918245 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 347/686] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:52:26 2022] GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac => generated 1741 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:52:27.937310 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-ed8c9067-884c-41a1-b1c2-3da4a0c0391f tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:27.937944 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-ed8c9067-884c-41a1-b1c2-3da4a0c0391f tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 73592c9c-6dae-4521-a03d-e02749530cac] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:27.949908 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-ed8c9067-884c-41a1-b1c2-3da4a0c0391f tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:27.950365 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-ed8c9067-884c-41a1-b1c2-3da4a0c0391f tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:27.951743 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-ed8c9067-884c-41a1-b1c2-3da4a0c0391f tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:27.952229 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-ed8c9067-884c-41a1-b1c2-3da4a0c0391f tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:28.089232 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-ed8c9067-884c-41a1-b1c2-3da4a0c0391f tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:28.097991 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-ed8c9067-884c-41a1-b1c2-3da4a0c0391f tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:28.099517 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-ed8c9067-884c-41a1-b1c2-3da4a0c0391f tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:28.100684 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-ed8c9067-884c-41a1-b1c2-3da4a0c0391f tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac" status: 200 len: 1741 microversion: 2.20 time: 0.167778 May 26 12:52:28.101504 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 340/687] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:52:27 2022] GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac => generated 1741 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:52:29.119999 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-54025a47-22e6-4e69-93af-5129b45a9266 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:29.120639 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-54025a47-22e6-4e69-93af-5129b45a9266 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 73592c9c-6dae-4521-a03d-e02749530cac] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:29.127724 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-54025a47-22e6-4e69-93af-5129b45a9266 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:29.129252 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-54025a47-22e6-4e69-93af-5129b45a9266 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:29.129252 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-54025a47-22e6-4e69-93af-5129b45a9266 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:29.129520 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-54025a47-22e6-4e69-93af-5129b45a9266 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:29.288083 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-54025a47-22e6-4e69-93af-5129b45a9266 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:29.296888 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-54025a47-22e6-4e69-93af-5129b45a9266 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:29.298365 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-54025a47-22e6-4e69-93af-5129b45a9266 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:29.299563 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-54025a47-22e6-4e69-93af-5129b45a9266 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac" status: 200 len: 1741 microversion: 2.20 time: 0.183449 May 26 12:52:29.300126 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 348/688] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:52:29 2022] GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac => generated 1741 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:52:30.318792 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-f2904eb6-5b58-4a0a-a0d8-5bc2d70f19bb tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:30.319487 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-f2904eb6-5b58-4a0a-a0d8-5bc2d70f19bb tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 73592c9c-6dae-4521-a03d-e02749530cac] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:30.322506 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG dbcounter [-] [124824] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:52:30.328509 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-f2904eb6-5b58-4a0a-a0d8-5bc2d70f19bb tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:30.329003 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-f2904eb6-5b58-4a0a-a0d8-5bc2d70f19bb tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:30.329969 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-f2904eb6-5b58-4a0a-a0d8-5bc2d70f19bb tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:30.335274 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-f2904eb6-5b58-4a0a-a0d8-5bc2d70f19bb tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:30.532830 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-f2904eb6-5b58-4a0a-a0d8-5bc2d70f19bb tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:30.540726 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-f2904eb6-5b58-4a0a-a0d8-5bc2d70f19bb tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:30.542236 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-f2904eb6-5b58-4a0a-a0d8-5bc2d70f19bb tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:30.543389 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-f2904eb6-5b58-4a0a-a0d8-5bc2d70f19bb tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac" status: 200 len: 1723 microversion: 2.20 time: 0.228980 May 26 12:52:30.543951 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 341/689] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:52:30 2022] GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac => generated 1723 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:52:31.563361 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-89e36ae1-e5fe-4ad6-b606-3361b4d620aa tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:31.563965 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-89e36ae1-e5fe-4ad6-b606-3361b4d620aa tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 73592c9c-6dae-4521-a03d-e02749530cac] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:31.570283 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-89e36ae1-e5fe-4ad6-b606-3361b4d620aa tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:31.570756 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-89e36ae1-e5fe-4ad6-b606-3361b4d620aa tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:31.571513 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-89e36ae1-e5fe-4ad6-b606-3361b4d620aa tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:31.571942 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-89e36ae1-e5fe-4ad6-b606-3361b4d620aa tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:31.704688 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-89e36ae1-e5fe-4ad6-b606-3361b4d620aa tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:31.712724 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-89e36ae1-e5fe-4ad6-b606-3361b4d620aa tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:31.714258 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-89e36ae1-e5fe-4ad6-b606-3361b4d620aa tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:31.715417 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-89e36ae1-e5fe-4ad6-b606-3361b4d620aa tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac" status: 200 len: 1723 microversion: 2.20 time: 0.156504 May 26 12:52:31.715994 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 349/690] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:52:31 2022] GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:52:32.734840 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-ac508ab0-70c8-4e49-9d1b-11f724940eba tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:32.735561 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-ac508ab0-70c8-4e49-9d1b-11f724940eba tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 73592c9c-6dae-4521-a03d-e02749530cac] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:32.742339 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-ac508ab0-70c8-4e49-9d1b-11f724940eba tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:32.742789 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-ac508ab0-70c8-4e49-9d1b-11f724940eba tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:32.743555 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-ac508ab0-70c8-4e49-9d1b-11f724940eba tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:32.743995 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-ac508ab0-70c8-4e49-9d1b-11f724940eba tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:32.891491 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-ac508ab0-70c8-4e49-9d1b-11f724940eba tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:32.899484 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-ac508ab0-70c8-4e49-9d1b-11f724940eba tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:32.900966 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-ac508ab0-70c8-4e49-9d1b-11f724940eba tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:32.902163 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-ac508ab0-70c8-4e49-9d1b-11f724940eba tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac" status: 200 len: 1726 microversion: 2.20 time: 0.171537 May 26 12:52:32.902725 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 342/691] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:52:32 2022] GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac => generated 1726 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:52:32.920352 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-93bce0de-7833-49fa-b0d1-8a1a9df99399 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cd4dedfd-2038-46f4-9115-031fae26401d"}} {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:52:32.921417 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-93bce0de-7833-49fa-b0d1-8a1a9df99399 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 73592c9c-6dae-4521-a03d-e02749530cac] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:32.927936 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-93bce0de-7833-49fa-b0d1-8a1a9df99399 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:32.928385 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-93bce0de-7833-49fa-b0d1-8a1a9df99399 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:32.929144 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-93bce0de-7833-49fa-b0d1-8a1a9df99399 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:32.929578 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-93bce0de-7833-49fa-b0d1-8a1a9df99399 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:33.920233 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [req-56e1230a-553b-42bf-a004-fdf6e800927a req-0063ed3e-1fe3-401f-87c4-ff244f6cb258 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73592c9c-6dae-4521-a03d-e02749530cac", "name": "network-vif-unplugged", "status": "completed", "tag": "d2fc86c7-8d2d-4221-a19f-e4847de64091"}]} {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:52:33.929877 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [req-56e1230a-553b-42bf-a004-fdf6e800927a req-0063ed3e-1fe3-401f-87c4-ff244f6cb258 service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:33.930396 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [req-56e1230a-553b-42bf-a004-fdf6e800927a req-0063ed3e-1fe3-401f-87c4-ff244f6cb258 service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:33.941196 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.compute.server_external_events [req-56e1230a-553b-42bf-a004-fdf6e800927a req-0063ed3e-1fe3-401f-87c4-ff244f6cb258 service nova] Unable to find a host for instance 73592c9c-6dae-4521-a03d-e02749530cac. Dropping event network-vif-unplugged {{(pid=124824) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 26 12:52:33.942336 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [req-56e1230a-553b-42bf-a004-fdf6e800927a req-0063ed3e-1fe3-401f-87c4-ff244f6cb258 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.026607 May 26 12:52:33.945191 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 343/692] 10.222.0.41 () {64 vars in 1317 bytes} [Thu May 26 12:52:33 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 28 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) May 26 12:52:34.090448 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-93bce0de-7833-49fa-b0d1-8a1a9df99399 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "POST /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.173659 May 26 12:52:34.090917 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 350/693] 10.222.0.41 () {62 vars in 1363 bytes} [Thu May 26 12:52:32 2022] POST /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac/os-volume_attachments => generated 188 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 12:52:34.214292 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-262e2830-4c70-4753-bab7-7d888b6f76f8 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:34.214792 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-262e2830-4c70-4753-bab7-7d888b6f76f8 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 73592c9c-6dae-4521-a03d-e02749530cac] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:34.220816 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-262e2830-4c70-4753-bab7-7d888b6f76f8 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:34.221269 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-262e2830-4c70-4753-bab7-7d888b6f76f8 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:34.222325 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-262e2830-4c70-4753-bab7-7d888b6f76f8 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:34.222761 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-262e2830-4c70-4753-bab7-7d888b6f76f8 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:34.922208 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-262e2830-4c70-4753-bab7-7d888b6f76f8 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "DELETE /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac/os-volume_attachments/cd4dedfd-2038-46f4-9115-031fae26401d" status: 202 len: 0 microversion: 2.20 time: 0.711698 May 26 12:52:34.923641 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 344/694] 10.222.0.41 () {60 vars in 1456 bytes} [Thu May 26 12:52:34 2022] DELETE /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac/os-volume_attachments/cd4dedfd-2038-46f4-9115-031fae26401d => generated 0 bytes in 713 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 26 12:52:34.980960 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-f6574a80-cb50-42ee-9b91-7aa0231c7b7d tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:52:34.981530 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-f6574a80-cb50-42ee-9b91-7aa0231c7b7d tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 73592c9c-6dae-4521-a03d-e02749530cac] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:34.988143 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-f6574a80-cb50-42ee-9b91-7aa0231c7b7d tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:34.988588 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-f6574a80-cb50-42ee-9b91-7aa0231c7b7d tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:34.989354 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-f6574a80-cb50-42ee-9b91-7aa0231c7b7d tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:34.989824 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-f6574a80-cb50-42ee-9b91-7aa0231c7b7d tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:35.258026 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-f6574a80-cb50-42ee-9b91-7aa0231c7b7d tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "POST /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac/action" status: 202 len: 0 microversion: 2.20 time: 0.281223 May 26 12:52:35.258897 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 351/695] 10.222.0.41 () {62 vars in 1318 bytes} [Thu May 26 12:52:34 2022] POST /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac/action => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 26 12:52:35.267638 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-595ff394-7880-47d4-a092-7bb959d0f0e8 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:35.268379 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-595ff394-7880-47d4-a092-7bb959d0f0e8 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 73592c9c-6dae-4521-a03d-e02749530cac] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:35.275260 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-595ff394-7880-47d4-a092-7bb959d0f0e8 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:35.275724 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-595ff394-7880-47d4-a092-7bb959d0f0e8 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:35.276526 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-595ff394-7880-47d4-a092-7bb959d0f0e8 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:35.276966 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-595ff394-7880-47d4-a092-7bb959d0f0e8 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:35.406810 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-595ff394-7880-47d4-a092-7bb959d0f0e8 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:35.414704 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-595ff394-7880-47d4-a092-7bb959d0f0e8 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:35.417930 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-595ff394-7880-47d4-a092-7bb959d0f0e8 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:35.417930 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-595ff394-7880-47d4-a092-7bb959d0f0e8 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac" status: 200 len: 1674 microversion: 2.20 time: 0.154369 May 26 12:52:35.417930 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 345/696] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:52:35 2022] GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac => generated 1674 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:52:36.436947 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-ca17b896-423f-41cd-b3a1-25cca72c4fa3 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:36.437575 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-ca17b896-423f-41cd-b3a1-25cca72c4fa3 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 73592c9c-6dae-4521-a03d-e02749530cac] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:36.443764 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-ca17b896-423f-41cd-b3a1-25cca72c4fa3 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:36.444213 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-ca17b896-423f-41cd-b3a1-25cca72c4fa3 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:36.445001 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-ca17b896-423f-41cd-b3a1-25cca72c4fa3 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:36.445433 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-ca17b896-423f-41cd-b3a1-25cca72c4fa3 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:36.579555 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-ca17b896-423f-41cd-b3a1-25cca72c4fa3 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:36.587798 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-ca17b896-423f-41cd-b3a1-25cca72c4fa3 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:36.589290 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-ca17b896-423f-41cd-b3a1-25cca72c4fa3 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:36.590532 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-ca17b896-423f-41cd-b3a1-25cca72c4fa3 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac" status: 200 len: 1674 microversion: 2.20 time: 0.158066 May 26 12:52:36.591167 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 352/697] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:52:36 2022] GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac => generated 1674 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:52:37.610309 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-fde254a4-57e6-4836-9288-f709d51e7430 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:37.610967 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-fde254a4-57e6-4836-9288-f709d51e7430 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 73592c9c-6dae-4521-a03d-e02749530cac] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:37.617746 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-fde254a4-57e6-4836-9288-f709d51e7430 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:37.618196 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-fde254a4-57e6-4836-9288-f709d51e7430 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:37.618973 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-fde254a4-57e6-4836-9288-f709d51e7430 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:37.619411 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-fde254a4-57e6-4836-9288-f709d51e7430 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:37.764359 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-fde254a4-57e6-4836-9288-f709d51e7430 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:37.774079 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-fde254a4-57e6-4836-9288-f709d51e7430 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:37.775709 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-fde254a4-57e6-4836-9288-f709d51e7430 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:37.776867 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-fde254a4-57e6-4836-9288-f709d51e7430 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac" status: 200 len: 1674 microversion: 2.20 time: 0.171183 May 26 12:52:37.777593 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 346/698] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:52:37 2022] GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac => generated 1674 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:52:38.797055 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-20c2d3f4-b8c9-4a8d-a696-6448d0c9820f tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:38.797688 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-20c2d3f4-b8c9-4a8d-a696-6448d0c9820f tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 73592c9c-6dae-4521-a03d-e02749530cac] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:38.806761 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-20c2d3f4-b8c9-4a8d-a696-6448d0c9820f tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:38.807374 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-20c2d3f4-b8c9-4a8d-a696-6448d0c9820f tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:38.808226 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-20c2d3f4-b8c9-4a8d-a696-6448d0c9820f tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:38.808744 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-20c2d3f4-b8c9-4a8d-a696-6448d0c9820f tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:38.952234 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-20c2d3f4-b8c9-4a8d-a696-6448d0c9820f tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:38.960588 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-20c2d3f4-b8c9-4a8d-a696-6448d0c9820f tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:38.965217 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-20c2d3f4-b8c9-4a8d-a696-6448d0c9820f tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:38.965217 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-20c2d3f4-b8c9-4a8d-a696-6448d0c9820f tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac" status: 200 len: 1732 microversion: 2.20 time: 0.170717 May 26 12:52:38.965217 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 353/699] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:52:38 2022] GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac => generated 1732 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:52:39.985458 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-472dab9d-a713-4874-890a-e7d1d0bdfcfc tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:39.986700 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-472dab9d-a713-4874-890a-e7d1d0bdfcfc tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 73592c9c-6dae-4521-a03d-e02749530cac] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:39.995129 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-472dab9d-a713-4874-890a-e7d1d0bdfcfc tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:39.995575 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-472dab9d-a713-4874-890a-e7d1d0bdfcfc tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:39.997836 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-472dab9d-a713-4874-890a-e7d1d0bdfcfc tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:39.998461 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-472dab9d-a713-4874-890a-e7d1d0bdfcfc tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:40.177465 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-472dab9d-a713-4874-890a-e7d1d0bdfcfc tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:40.187886 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-472dab9d-a713-4874-890a-e7d1d0bdfcfc tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:40.189845 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-472dab9d-a713-4874-890a-e7d1d0bdfcfc tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:40.191483 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-472dab9d-a713-4874-890a-e7d1d0bdfcfc tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac" status: 200 len: 1732 microversion: 2.20 time: 0.211918 May 26 12:52:40.192339 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 347/700] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:52:39 2022] GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac => generated 1732 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:52:41.210142 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-c58cd132-6d9a-47a2-bdab-213e672ff2dc tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:41.211509 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-c58cd132-6d9a-47a2-bdab-213e672ff2dc tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 73592c9c-6dae-4521-a03d-e02749530cac] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:41.224905 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-c58cd132-6d9a-47a2-bdab-213e672ff2dc tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:41.224905 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-c58cd132-6d9a-47a2-bdab-213e672ff2dc tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:41.224905 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-c58cd132-6d9a-47a2-bdab-213e672ff2dc tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:41.224905 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-c58cd132-6d9a-47a2-bdab-213e672ff2dc tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:41.226965 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG dbcounter [-] [124823] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=124823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:52:41.397963 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-c58cd132-6d9a-47a2-bdab-213e672ff2dc tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:41.406767 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-c58cd132-6d9a-47a2-bdab-213e672ff2dc tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:41.408221 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-c58cd132-6d9a-47a2-bdab-213e672ff2dc tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:41.409405 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-c58cd132-6d9a-47a2-bdab-213e672ff2dc tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac" status: 200 len: 1732 microversion: 2.20 time: 0.204056 May 26 12:52:41.410077 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 354/701] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:52:41 2022] GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac => generated 1732 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:52:42.428399 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-2fcce20c-9e85-4676-b850-a8eeecd45a66 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:42.429400 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-2fcce20c-9e85-4676-b850-a8eeecd45a66 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 73592c9c-6dae-4521-a03d-e02749530cac] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:42.443579 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-2fcce20c-9e85-4676-b850-a8eeecd45a66 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:42.444030 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-2fcce20c-9e85-4676-b850-a8eeecd45a66 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:42.444817 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-2fcce20c-9e85-4676-b850-a8eeecd45a66 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:42.445248 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-2fcce20c-9e85-4676-b850-a8eeecd45a66 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:42.605538 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-2fcce20c-9e85-4676-b850-a8eeecd45a66 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:42.613716 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-2fcce20c-9e85-4676-b850-a8eeecd45a66 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:42.615235 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-2fcce20c-9e85-4676-b850-a8eeecd45a66 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:42.616411 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-2fcce20c-9e85-4676-b850-a8eeecd45a66 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac" status: 200 len: 1732 microversion: 2.20 time: 0.191979 May 26 12:52:42.626628 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 348/702] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:52:42 2022] GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac => generated 1732 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:52:43.642778 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-eee7b9ae-658d-435a-81a0-cf64d5974585 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:43.644615 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-eee7b9ae-658d-435a-81a0-cf64d5974585 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 73592c9c-6dae-4521-a03d-e02749530cac] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:43.655577 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-eee7b9ae-658d-435a-81a0-cf64d5974585 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:43.656490 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-eee7b9ae-658d-435a-81a0-cf64d5974585 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:43.657604 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-eee7b9ae-658d-435a-81a0-cf64d5974585 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:43.658881 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-eee7b9ae-658d-435a-81a0-cf64d5974585 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:43.829457 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-eee7b9ae-658d-435a-81a0-cf64d5974585 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:43.854612 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-eee7b9ae-658d-435a-81a0-cf64d5974585 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:43.854612 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-eee7b9ae-658d-435a-81a0-cf64d5974585 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:43.854612 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-eee7b9ae-658d-435a-81a0-cf64d5974585 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac" status: 200 len: 1732 microversion: 2.20 time: 0.209060 May 26 12:52:43.855070 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 355/703] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:52:43 2022] GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac => generated 1732 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:52:44.872245 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-31cfdfb0-acff-4897-93b3-b9bf0a33cca4 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:44.873001 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-31cfdfb0-acff-4897-93b3-b9bf0a33cca4 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 73592c9c-6dae-4521-a03d-e02749530cac] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:44.884352 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-31cfdfb0-acff-4897-93b3-b9bf0a33cca4 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:44.884821 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-31cfdfb0-acff-4897-93b3-b9bf0a33cca4 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:44.885886 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-31cfdfb0-acff-4897-93b3-b9bf0a33cca4 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:44.886528 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-31cfdfb0-acff-4897-93b3-b9bf0a33cca4 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:45.043089 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-31cfdfb0-acff-4897-93b3-b9bf0a33cca4 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:45.052051 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-31cfdfb0-acff-4897-93b3-b9bf0a33cca4 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:45.053648 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-31cfdfb0-acff-4897-93b3-b9bf0a33cca4 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:45.054992 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-31cfdfb0-acff-4897-93b3-b9bf0a33cca4 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac" status: 200 len: 1732 microversion: 2.20 time: 0.187094 May 26 12:52:45.055784 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 349/704] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:52:44 2022] GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac => generated 1732 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:52:46.077822 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-8c4899e3-f6ee-4cea-9512-c34382432f4e tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:46.077822 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-8c4899e3-f6ee-4cea-9512-c34382432f4e tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 73592c9c-6dae-4521-a03d-e02749530cac] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:46.084526 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-8c4899e3-f6ee-4cea-9512-c34382432f4e tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:46.091627 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-8c4899e3-f6ee-4cea-9512-c34382432f4e tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:46.092510 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-8c4899e3-f6ee-4cea-9512-c34382432f4e tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:46.093117 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-8c4899e3-f6ee-4cea-9512-c34382432f4e tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:46.279509 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-8c4899e3-f6ee-4cea-9512-c34382432f4e tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:46.288149 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-8c4899e3-f6ee-4cea-9512-c34382432f4e tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:46.289800 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-8c4899e3-f6ee-4cea-9512-c34382432f4e tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:46.291462 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-8c4899e3-f6ee-4cea-9512-c34382432f4e tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac" status: 200 len: 1732 microversion: 2.20 time: 0.221629 May 26 12:52:46.296504 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 356/705] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:52:46 2022] GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac => generated 1732 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:52:47.310948 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-ba036270-bc85-4fea-8f7c-7d10658640d7 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:47.312010 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-ba036270-bc85-4fea-8f7c-7d10658640d7 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 73592c9c-6dae-4521-a03d-e02749530cac] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:47.319136 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-ba036270-bc85-4fea-8f7c-7d10658640d7 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:47.332898 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-ba036270-bc85-4fea-8f7c-7d10658640d7 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:47.332898 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-ba036270-bc85-4fea-8f7c-7d10658640d7 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:47.332898 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-ba036270-bc85-4fea-8f7c-7d10658640d7 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:47.332898 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG dbcounter [-] [124824] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=124824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:52:47.483270 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-ba036270-bc85-4fea-8f7c-7d10658640d7 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:47.483270 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-ba036270-bc85-4fea-8f7c-7d10658640d7 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:47.483821 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-ba036270-bc85-4fea-8f7c-7d10658640d7 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:47.483821 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-ba036270-bc85-4fea-8f7c-7d10658640d7 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac" status: 200 len: 1732 microversion: 2.20 time: 0.172289 May 26 12:52:47.483821 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 350/706] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:52:47 2022] GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac => generated 1732 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:52:48.499061 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-a7b47e60-ca87-4d27-81a7-d5c4be442067 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:48.499842 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-a7b47e60-ca87-4d27-81a7-d5c4be442067 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 73592c9c-6dae-4521-a03d-e02749530cac] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:48.506772 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-a7b47e60-ca87-4d27-81a7-d5c4be442067 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:48.507222 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-a7b47e60-ca87-4d27-81a7-d5c4be442067 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:48.507994 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-a7b47e60-ca87-4d27-81a7-d5c4be442067 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:48.508427 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-a7b47e60-ca87-4d27-81a7-d5c4be442067 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:48.645812 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-a7b47e60-ca87-4d27-81a7-d5c4be442067 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:48.655715 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-a7b47e60-ca87-4d27-81a7-d5c4be442067 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:48.657215 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-a7b47e60-ca87-4d27-81a7-d5c4be442067 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:48.658426 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-a7b47e60-ca87-4d27-81a7-d5c4be442067 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac" status: 200 len: 1732 microversion: 2.20 time: 0.163461 May 26 12:52:48.659018 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 357/707] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:52:48 2022] GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac => generated 1732 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:52:49.678116 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-293ffa5a-d31f-4f17-8257-7dd18a9bec5e tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:49.678662 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-293ffa5a-d31f-4f17-8257-7dd18a9bec5e tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 73592c9c-6dae-4521-a03d-e02749530cac] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:49.686584 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-293ffa5a-d31f-4f17-8257-7dd18a9bec5e tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:49.687034 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-293ffa5a-d31f-4f17-8257-7dd18a9bec5e tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:49.687820 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-293ffa5a-d31f-4f17-8257-7dd18a9bec5e tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:49.688259 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-293ffa5a-d31f-4f17-8257-7dd18a9bec5e tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:49.834134 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-293ffa5a-d31f-4f17-8257-7dd18a9bec5e tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:49.843059 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-293ffa5a-d31f-4f17-8257-7dd18a9bec5e tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:49.844558 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-293ffa5a-d31f-4f17-8257-7dd18a9bec5e tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:49.845738 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-293ffa5a-d31f-4f17-8257-7dd18a9bec5e tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac" status: 200 len: 1732 microversion: 2.20 time: 0.172076 May 26 12:52:49.846561 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 351/708] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:52:49 2022] GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac => generated 1732 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:52:50.865018 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-41a41c3a-0a37-4829-852d-3f0e4ef7539d tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:50.865747 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-41a41c3a-0a37-4829-852d-3f0e4ef7539d tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 73592c9c-6dae-4521-a03d-e02749530cac] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:50.873034 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-41a41c3a-0a37-4829-852d-3f0e4ef7539d tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:50.873481 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-41a41c3a-0a37-4829-852d-3f0e4ef7539d tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:50.874285 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-41a41c3a-0a37-4829-852d-3f0e4ef7539d tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:50.874713 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-41a41c3a-0a37-4829-852d-3f0e4ef7539d tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:51.017077 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-41a41c3a-0a37-4829-852d-3f0e4ef7539d tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:51.025586 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-41a41c3a-0a37-4829-852d-3f0e4ef7539d tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:51.027126 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-41a41c3a-0a37-4829-852d-3f0e4ef7539d tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:51.030137 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-41a41c3a-0a37-4829-852d-3f0e4ef7539d tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac" status: 200 len: 1732 microversion: 2.20 time: 0.167167 May 26 12:52:51.030137 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 358/709] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:52:50 2022] GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac => generated 1732 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:52:52.047785 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-c145d37c-0722-4d6b-a17e-8ff258d894e2 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:52.048502 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-c145d37c-0722-4d6b-a17e-8ff258d894e2 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 73592c9c-6dae-4521-a03d-e02749530cac] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:52.055517 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-c145d37c-0722-4d6b-a17e-8ff258d894e2 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:52.056106 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-c145d37c-0722-4d6b-a17e-8ff258d894e2 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:52.056884 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-c145d37c-0722-4d6b-a17e-8ff258d894e2 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:52.057314 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-c145d37c-0722-4d6b-a17e-8ff258d894e2 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:52.117739 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [req-6168d689-1d5e-40fe-ac9b-14d6ad28bbe6 req-ee7781d8-1610-4fc9-9fbc-d949b6aadd63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73592c9c-6dae-4521-a03d-e02749530cac", "name": "network-vif-plugged", "status": "completed", "tag": "d2fc86c7-8d2d-4221-a19f-e4847de64091"}]} {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:52:52.127918 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [req-6168d689-1d5e-40fe-ac9b-14d6ad28bbe6 req-ee7781d8-1610-4fc9-9fbc-d949b6aadd63 service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:52.128361 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [req-6168d689-1d5e-40fe-ac9b-14d6ad28bbe6 req-ee7781d8-1610-4fc9-9fbc-d949b6aadd63 service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:52.140122 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.compute.server_external_events [req-6168d689-1d5e-40fe-ac9b-14d6ad28bbe6 req-ee7781d8-1610-4fc9-9fbc-d949b6aadd63 service nova] Creating event network-vif-plugged:d2fc86c7-8d2d-4221-a19f-e4847de64091 for instance 73592c9c-6dae-4521-a03d-e02749530cac on hv-cinder-81571 May 26 12:52:52.145250 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [req-6168d689-1d5e-40fe-ac9b-14d6ad28bbe6 req-ee7781d8-1610-4fc9-9fbc-d949b6aadd63 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037130 May 26 12:52:52.145895 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 359/710] 10.222.0.41 () {64 vars in 1317 bytes} [Thu May 26 12:52:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:52:52.202717 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-c145d37c-0722-4d6b-a17e-8ff258d894e2 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:52.211045 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-c145d37c-0722-4d6b-a17e-8ff258d894e2 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:52.212709 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-c145d37c-0722-4d6b-a17e-8ff258d894e2 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:52.213932 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-c145d37c-0722-4d6b-a17e-8ff258d894e2 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac" status: 200 len: 1732 microversion: 2.20 time: 0.170980 May 26 12:52:52.214498 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 352/711] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:52:52 2022] GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac => generated 1732 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:52:53.234916 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-f0ebe0af-3b17-48a5-ad9e-a259e2cba809 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:53.235619 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-f0ebe0af-3b17-48a5-ad9e-a259e2cba809 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 73592c9c-6dae-4521-a03d-e02749530cac] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:53.241969 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-f0ebe0af-3b17-48a5-ad9e-a259e2cba809 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:53.242529 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-f0ebe0af-3b17-48a5-ad9e-a259e2cba809 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:53.243410 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-f0ebe0af-3b17-48a5-ad9e-a259e2cba809 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:53.243893 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-f0ebe0af-3b17-48a5-ad9e-a259e2cba809 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:53.384105 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-f0ebe0af-3b17-48a5-ad9e-a259e2cba809 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:53.392659 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-f0ebe0af-3b17-48a5-ad9e-a259e2cba809 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:53.394190 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-f0ebe0af-3b17-48a5-ad9e-a259e2cba809 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:53.395360 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-f0ebe0af-3b17-48a5-ad9e-a259e2cba809 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac" status: 200 len: 1732 microversion: 2.20 time: 0.165558 May 26 12:52:53.395976 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 360/712] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:52:53 2022] GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac => generated 1732 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:52:54.415451 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-7ffcaa35-fc40-4101-88ab-5e72b0905e98 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:54.416557 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-7ffcaa35-fc40-4101-88ab-5e72b0905e98 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 73592c9c-6dae-4521-a03d-e02749530cac] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:54.424160 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-7ffcaa35-fc40-4101-88ab-5e72b0905e98 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:54.424610 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-7ffcaa35-fc40-4101-88ab-5e72b0905e98 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:54.425429 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-7ffcaa35-fc40-4101-88ab-5e72b0905e98 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:54.425893 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-7ffcaa35-fc40-4101-88ab-5e72b0905e98 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:54.567106 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-7ffcaa35-fc40-4101-88ab-5e72b0905e98 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:54.575171 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-7ffcaa35-fc40-4101-88ab-5e72b0905e98 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:54.576705 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-7ffcaa35-fc40-4101-88ab-5e72b0905e98 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:54.577900 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-7ffcaa35-fc40-4101-88ab-5e72b0905e98 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac" status: 200 len: 1732 microversion: 2.20 time: 0.167144 May 26 12:52:54.578462 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 353/713] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:52:54 2022] GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac => generated 1732 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:52:55.596917 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-2b220600-e7e4-41ce-87bd-6169fce95ee4 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:55.597535 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-2b220600-e7e4-41ce-87bd-6169fce95ee4 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 73592c9c-6dae-4521-a03d-e02749530cac] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:55.604687 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-2b220600-e7e4-41ce-87bd-6169fce95ee4 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:55.605174 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-2b220600-e7e4-41ce-87bd-6169fce95ee4 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:55.606066 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-2b220600-e7e4-41ce-87bd-6169fce95ee4 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:55.606541 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-2b220600-e7e4-41ce-87bd-6169fce95ee4 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:55.740125 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-2b220600-e7e4-41ce-87bd-6169fce95ee4 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:55.748167 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-2b220600-e7e4-41ce-87bd-6169fce95ee4 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:55.749689 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-2b220600-e7e4-41ce-87bd-6169fce95ee4 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:55.750856 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-2b220600-e7e4-41ce-87bd-6169fce95ee4 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac" status: 200 len: 1732 microversion: 2.20 time: 0.158839 May 26 12:52:55.751422 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 361/714] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:52:55 2022] GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac => generated 1732 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:52:56.769794 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-293dd352-6af2-4d6a-971a-676d5e4ab6d8 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:52:56.770410 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-293dd352-6af2-4d6a-971a-676d5e4ab6d8 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 73592c9c-6dae-4521-a03d-e02749530cac] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:52:56.776683 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-293dd352-6af2-4d6a-971a-676d5e4ab6d8 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:56.777130 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-293dd352-6af2-4d6a-971a-676d5e4ab6d8 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:56.777941 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-293dd352-6af2-4d6a-971a-676d5e4ab6d8 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:52:56.778384 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-293dd352-6af2-4d6a-971a-676d5e4ab6d8 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:52:56.909564 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-293dd352-6af2-4d6a-971a-676d5e4ab6d8 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:56.918243 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-293dd352-6af2-4d6a-971a-676d5e4ab6d8 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:56.919806 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-293dd352-6af2-4d6a-971a-676d5e4ab6d8 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:52:56.921643 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-293dd352-6af2-4d6a-971a-676d5e4ab6d8 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac" status: 200 len: 1719 microversion: 2.20 time: 0.155111 May 26 12:52:56.922220 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 354/715] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:52:56 2022] GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac => generated 1719 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:53:10.910880 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-ecb4fd62-f03c-4943-aed3-2e9f0fa7f719 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:10.911950 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-ecb4fd62-f03c-4943-aed3-2e9f0fa7f719 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: 77ecf3b8-40c2-4eff-ac61-fca2cedc1446] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:10.917287 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG dbcounter [-] [124823] Writing DB stats nova_api:SELECT=31 {{(pid=124823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:53:10.917976 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG dbcounter [-] [124823] Writing DB stats nova_cell1:SELECT=42 {{(pid=124823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:53:10.919919 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-ecb4fd62-f03c-4943-aed3-2e9f0fa7f719 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:10.920366 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-ecb4fd62-f03c-4943-aed3-2e9f0fa7f719 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:10.921136 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-ecb4fd62-f03c-4943-aed3-2e9f0fa7f719 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:10.921796 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-ecb4fd62-f03c-4943-aed3-2e9f0fa7f719 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:10.945021 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-ecb4fd62-f03c-4943-aed3-2e9f0fa7f719 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "GET /compute/v2.1/servers/77ecf3b8-40c2-4eff-ac61-fca2cedc1446/ips" status: 200 len: 150 microversion: 2.1 time: 0.038101 May 26 12:53:10.945882 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 362/716] 10.222.0.41 () {58 vars in 1247 bytes} [Thu May 26 12:53:10 2022] GET /compute/v2.1/servers/77ecf3b8-40c2-4eff-ac61-fca2cedc1446/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:53:12.722503 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-dca87bc2-caaa-45f1-b20f-57238d320fc5 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "91c8ca39-9e4e-4fa0-8efb-ea6aa2bb076f"}} {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:53:12.724242 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-dca87bc2-caaa-45f1-b20f-57238d320fc5 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: 77ecf3b8-40c2-4eff-ac61-fca2cedc1446] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:12.726523 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG dbcounter [-] [124824] Writing DB stats nova_api:SELECT=27 {{(pid=124824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:53:12.727174 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG dbcounter [-] [124824] Writing DB stats nova_cell1:SELECT=29 {{(pid=124824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:53:12.732385 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-dca87bc2-caaa-45f1-b20f-57238d320fc5 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:12.733038 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-dca87bc2-caaa-45f1-b20f-57238d320fc5 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:12.734046 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-dca87bc2-caaa-45f1-b20f-57238d320fc5 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:12.734641 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-dca87bc2-caaa-45f1-b20f-57238d320fc5 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:13.482601 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-dca87bc2-caaa-45f1-b20f-57238d320fc5 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "POST /compute/v2.1/servers/77ecf3b8-40c2-4eff-ac61-fca2cedc1446/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.764395 May 26 12:53:13.484021 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 355/717] 10.222.0.41 () {60 vars in 1322 bytes} [Thu May 26 12:53:12 2022] POST /compute/v2.1/servers/77ecf3b8-40c2-4eff-ac61-fca2cedc1446/os-volume_attachments => generated 194 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:53:21.367511 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-4b3b126c-41a1-4d43-9434-4b0b4fac2404 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:21.368198 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-4b3b126c-41a1-4d43-9434-4b0b4fac2404 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: 77ecf3b8-40c2-4eff-ac61-fca2cedc1446] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:21.377392 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-4b3b126c-41a1-4d43-9434-4b0b4fac2404 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:21.377902 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-4b3b126c-41a1-4d43-9434-4b0b4fac2404 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:21.378713 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-4b3b126c-41a1-4d43-9434-4b0b4fac2404 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:21.379158 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-4b3b126c-41a1-4d43-9434-4b0b4fac2404 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:21.487023 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.objects.instance [None req-4b3b126c-41a1-4d43-9434-4b0b4fac2404 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lazy-loading 'services' on Instance uuid 77ecf3b8-40c2-4eff-ac61-fca2cedc1446 {{(pid=124823) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:53:21.734209 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-4b3b126c-41a1-4d43-9434-4b0b4fac2404 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "DELETE /compute/v2.1/servers/77ecf3b8-40c2-4eff-ac61-fca2cedc1446/os-volume_attachments/91c8ca39-9e4e-4fa0-8efb-ea6aa2bb076f" status: 202 len: 0 microversion: 2.1 time: 0.370771 May 26 12:53:21.737702 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 363/718] 10.222.0.41 () {58 vars in 1415 bytes} [Thu May 26 12:53:21 2022] DELETE /compute/v2.1/servers/77ecf3b8-40c2-4eff-ac61-fca2cedc1446/os-volume_attachments/91c8ca39-9e4e-4fa0-8efb-ea6aa2bb076f => generated 0 bytes in 372 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 12:53:21.745038 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-7be35d53-67f1-4fa3-9ff9-1e8a3b85da0e tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:21.746305 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-7be35d53-67f1-4fa3-9ff9-1e8a3b85da0e tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: 77ecf3b8-40c2-4eff-ac61-fca2cedc1446] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:21.753931 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-7be35d53-67f1-4fa3-9ff9-1e8a3b85da0e tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:21.754455 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-7be35d53-67f1-4fa3-9ff9-1e8a3b85da0e tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:21.755360 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-7be35d53-67f1-4fa3-9ff9-1e8a3b85da0e tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:21.755772 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-7be35d53-67f1-4fa3-9ff9-1e8a3b85da0e tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:21.787140 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-7be35d53-67f1-4fa3-9ff9-1e8a3b85da0e tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "GET /compute/v2.1/servers/77ecf3b8-40c2-4eff-ac61-fca2cedc1446/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047493 May 26 12:53:21.787979 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 356/719] 10.222.0.41 () {58 vars in 1301 bytes} [Thu May 26 12:53:21 2022] GET /compute/v2.1/servers/77ecf3b8-40c2-4eff-ac61-fca2cedc1446/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:53:22.807107 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-88129601-f126-42db-bfe6-9b644c2ff4be tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:22.808793 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-88129601-f126-42db-bfe6-9b644c2ff4be tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: 77ecf3b8-40c2-4eff-ac61-fca2cedc1446] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:22.818249 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-88129601-f126-42db-bfe6-9b644c2ff4be tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:22.818710 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-88129601-f126-42db-bfe6-9b644c2ff4be tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:22.820673 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-88129601-f126-42db-bfe6-9b644c2ff4be tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:22.821120 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-88129601-f126-42db-bfe6-9b644c2ff4be tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:22.876321 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-88129601-f126-42db-bfe6-9b644c2ff4be tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "GET /compute/v2.1/servers/77ecf3b8-40c2-4eff-ac61-fca2cedc1446/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080652 May 26 12:53:22.877202 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 364/720] 10.222.0.41 () {58 vars in 1301 bytes} [Thu May 26 12:53:22 2022] GET /compute/v2.1/servers/77ecf3b8-40c2-4eff-ac61-fca2cedc1446/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:53:23.889680 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-ab64109f-06d3-46b8-9a77-2f2e4e86b67a tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:23.890726 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-ab64109f-06d3-46b8-9a77-2f2e4e86b67a tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: 77ecf3b8-40c2-4eff-ac61-fca2cedc1446] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:23.901347 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-ab64109f-06d3-46b8-9a77-2f2e4e86b67a tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:23.902103 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-ab64109f-06d3-46b8-9a77-2f2e4e86b67a tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:23.903104 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-ab64109f-06d3-46b8-9a77-2f2e4e86b67a tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:23.903816 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-ab64109f-06d3-46b8-9a77-2f2e4e86b67a tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:23.942366 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-ab64109f-06d3-46b8-9a77-2f2e4e86b67a tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "GET /compute/v2.1/servers/77ecf3b8-40c2-4eff-ac61-fca2cedc1446/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057624 May 26 12:53:23.943664 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 357/721] 10.222.0.41 () {58 vars in 1301 bytes} [Thu May 26 12:53:23 2022] GET /compute/v2.1/servers/77ecf3b8-40c2-4eff-ac61-fca2cedc1446/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 12:53:24.020538 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-cd6d836d-6d8d-4e9b-ab74-0651dfa65b55 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:24.021847 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-cd6d836d-6d8d-4e9b-ab74-0651dfa65b55 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: 77ecf3b8-40c2-4eff-ac61-fca2cedc1446] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:24.029437 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-cd6d836d-6d8d-4e9b-ab74-0651dfa65b55 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:24.030717 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-cd6d836d-6d8d-4e9b-ab74-0651dfa65b55 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:24.031498 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-cd6d836d-6d8d-4e9b-ab74-0651dfa65b55 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:24.032123 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-cd6d836d-6d8d-4e9b-ab74-0651dfa65b55 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:24.067971 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-cd6d836d-6d8d-4e9b-ab74-0651dfa65b55 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: 77ecf3b8-40c2-4eff-ac61-fca2cedc1446] Going to try to terminate instance {{(pid=124823) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 12:53:24.387011 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-cd6d836d-6d8d-4e9b-ab74-0651dfa65b55 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "DELETE /compute/v2.1/servers/77ecf3b8-40c2-4eff-ac61-fca2cedc1446" status: 204 len: 0 microversion: 2.1 time: 0.369993 May 26 12:53:24.388831 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 365/722] 10.222.0.41 () {58 vars in 1238 bytes} [Thu May 26 12:53:24 2022] DELETE /compute/v2.1/servers/77ecf3b8-40c2-4eff-ac61-fca2cedc1446 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 12:53:24.397363 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-fb8e59d6-9b89-4f8a-bb31-db94bf2e2152 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:24.398619 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-fb8e59d6-9b89-4f8a-bb31-db94bf2e2152 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: 77ecf3b8-40c2-4eff-ac61-fca2cedc1446] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:24.405780 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-fb8e59d6-9b89-4f8a-bb31-db94bf2e2152 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:24.406461 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-fb8e59d6-9b89-4f8a-bb31-db94bf2e2152 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:24.407529 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-fb8e59d6-9b89-4f8a-bb31-db94bf2e2152 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:24.408261 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-fb8e59d6-9b89-4f8a-bb31-db94bf2e2152 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:24.566712 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-fb8e59d6-9b89-4f8a-bb31-db94bf2e2152 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0537911b91184fcdbdcc9e93ec3fe5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad768b45d17480d8d6bbbcff6032c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:24.578405 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-fb8e59d6-9b89-4f8a-bb31-db94bf2e2152 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "GET /compute/v2.1/servers/77ecf3b8-40c2-4eff-ac61-fca2cedc1446" status: 200 len: 1682 microversion: 2.1 time: 0.184812 May 26 12:53:24.579465 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 358/723] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:53:24 2022] GET /compute/v2.1/servers/77ecf3b8-40c2-4eff-ac61-fca2cedc1446 => generated 1682 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:53:25.597306 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-84eade33-c998-4fde-8012-87c0fed67e7f tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:25.598076 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-84eade33-c998-4fde-8012-87c0fed67e7f tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: 77ecf3b8-40c2-4eff-ac61-fca2cedc1446] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:25.612881 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-84eade33-c998-4fde-8012-87c0fed67e7f tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:25.613338 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-84eade33-c998-4fde-8012-87c0fed67e7f tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:25.614151 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-84eade33-c998-4fde-8012-87c0fed67e7f tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:25.614778 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-84eade33-c998-4fde-8012-87c0fed67e7f tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:25.811351 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-84eade33-c998-4fde-8012-87c0fed67e7f tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0537911b91184fcdbdcc9e93ec3fe5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad768b45d17480d8d6bbbcff6032c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:25.824584 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-84eade33-c998-4fde-8012-87c0fed67e7f tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "GET /compute/v2.1/servers/77ecf3b8-40c2-4eff-ac61-fca2cedc1446" status: 200 len: 1682 microversion: 2.1 time: 0.232194 May 26 12:53:25.825182 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 366/724] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:53:25 2022] GET /compute/v2.1/servers/77ecf3b8-40c2-4eff-ac61-fca2cedc1446 => generated 1682 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:53:26.855869 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-35b31be0-d277-49e3-900a-d15438ba6bf6 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:26.857156 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-35b31be0-d277-49e3-900a-d15438ba6bf6 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: 77ecf3b8-40c2-4eff-ac61-fca2cedc1446] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:26.864398 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-35b31be0-d277-49e3-900a-d15438ba6bf6 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:26.865109 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-35b31be0-d277-49e3-900a-d15438ba6bf6 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:26.866210 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-35b31be0-d277-49e3-900a-d15438ba6bf6 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:26.866798 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-35b31be0-d277-49e3-900a-d15438ba6bf6 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:27.024490 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-35b31be0-d277-49e3-900a-d15438ba6bf6 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0537911b91184fcdbdcc9e93ec3fe5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad768b45d17480d8d6bbbcff6032c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:27.033018 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-35b31be0-d277-49e3-900a-d15438ba6bf6 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "GET /compute/v2.1/servers/77ecf3b8-40c2-4eff-ac61-fca2cedc1446" status: 200 len: 1682 microversion: 2.1 time: 0.181157 May 26 12:53:27.033624 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 359/725] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:53:26 2022] GET /compute/v2.1/servers/77ecf3b8-40c2-4eff-ac61-fca2cedc1446 => generated 1682 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:53:27.632467 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [req-53a8a646-fca1-49f4-8c40-f7475b122f66 req-d079263d-d065-4cc9-9e66-3ee6c6ac9745 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77ecf3b8-40c2-4eff-ac61-fca2cedc1446", "name": "network-vif-deleted", "tag": "0a37403c-8949-4ad9-9963-4bc69e1e8094"}]} {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:53:27.657845 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [req-53a8a646-fca1-49f4-8c40-f7475b122f66 req-d079263d-d065-4cc9-9e66-3ee6c6ac9745 service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:27.658287 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [req-53a8a646-fca1-49f4-8c40-f7475b122f66 req-d079263d-d065-4cc9-9e66-3ee6c6ac9745 service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:27.684263 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.compute.server_external_events [req-53a8a646-fca1-49f4-8c40-f7475b122f66 req-d079263d-d065-4cc9-9e66-3ee6c6ac9745 service nova] Creating event network-vif-deleted:0a37403c-8949-4ad9-9963-4bc69e1e8094 for instance 77ecf3b8-40c2-4eff-ac61-fca2cedc1446 on hv-cinder-81571 May 26 12:53:27.692749 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [req-53a8a646-fca1-49f4-8c40-f7475b122f66 req-d079263d-d065-4cc9-9e66-3ee6c6ac9745 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064504 May 26 12:53:27.696125 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 367/726] 10.222.0.41 () {64 vars in 1317 bytes} [Thu May 26 12:53:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:53:28.050858 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-d17ae0a3-1b68-4484-9cca-8ccbeb16a36c tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:28.052066 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-d17ae0a3-1b68-4484-9cca-8ccbeb16a36c tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: 77ecf3b8-40c2-4eff-ac61-fca2cedc1446] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:28.058581 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-d17ae0a3-1b68-4484-9cca-8ccbeb16a36c tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:28.059209 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-d17ae0a3-1b68-4484-9cca-8ccbeb16a36c tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:28.060160 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-d17ae0a3-1b68-4484-9cca-8ccbeb16a36c tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:28.060757 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-d17ae0a3-1b68-4484-9cca-8ccbeb16a36c tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:28.111772 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-d17ae0a3-1b68-4484-9cca-8ccbeb16a36c tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:28.112223 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-d17ae0a3-1b68-4484-9cca-8ccbeb16a36c tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:28.112677 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.objects.instance [None req-d17ae0a3-1b68-4484-9cca-8ccbeb16a36c tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lazy-loading 'fault' on Instance uuid 77ecf3b8-40c2-4eff-ac61-fca2cedc1446 {{(pid=124824) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:53:28.173998 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-d17ae0a3-1b68-4484-9cca-8ccbeb16a36c tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0537911b91184fcdbdcc9e93ec3fe5b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad768b45d17480d8d6bbbcff6032c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:28.182593 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-d17ae0a3-1b68-4484-9cca-8ccbeb16a36c tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "GET /compute/v2.1/servers/77ecf3b8-40c2-4eff-ac61-fca2cedc1446" status: 200 len: 1331 microversion: 2.1 time: 0.135594 May 26 12:53:28.184731 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 360/727] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:53:28 2022] GET /compute/v2.1/servers/77ecf3b8-40c2-4eff-ac61-fca2cedc1446 => generated 1331 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:53:29.201546 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-01784685-def9-4c91-b30c-77587e944b10 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:29.202290 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-01784685-def9-4c91-b30c-77587e944b10 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: 77ecf3b8-40c2-4eff-ac61-fca2cedc1446] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:29.211121 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-01784685-def9-4c91-b30c-77587e944b10 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:29.211945 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-01784685-def9-4c91-b30c-77587e944b10 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:29.212730 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-01784685-def9-4c91-b30c-77587e944b10 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:29.213331 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-01784685-def9-4c91-b30c-77587e944b10 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:29.231228 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.wsgi [None req-01784685-def9-4c91-b30c-77587e944b10 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] HTTP exception thrown: Instance 77ecf3b8-40c2-4eff-ac61-fca2cedc1446 could not be found. May 26 12:53:29.232837 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-01784685-def9-4c91-b30c-77587e944b10 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Request method failure captured: May 26 12:53:29.232837 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: request: GET /compute/v2.1/servers/77ecf3b8-40c2-4eff-ac61-fca2cedc1446 HTTP/1.1 May 26 12:53:29.232837 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Accept: application/json May 26 12:53:29.232837 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Accept-Encoding: identity May 26 12:53:29.232837 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Connection: close May 26 12:53:29.232837 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Content-Length: 0 May 26 12:53:29.232837 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Content-Type: application/json May 26 12:53:29.232837 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Host: 10.222.0.41 May 26 12:53:29.232837 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Openstack-System-Scope: None May 26 12:53:29.232837 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: User-Agent: python-urllib3/1.26.9 May 26 12:53:29.232837 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Auth-Token: gAAAAABij3aYTDT6d91IIen8MNgNrsA0ohBGn_dUC2tsponOFwNurwjlknBmFB36blSobobmDRibGa26en17LZfjuhgOSZiQsswJxea6OZWaEAKHfDkIbtu7XpKpGW-ZBZHCz2dZb9rYCBos_UyGkZJY7k8n757Ijkdz5EguRL9a0MDFor49yAU May 26 12:53:29.232837 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Domain-Id: None May 26 12:53:29.232837 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Domain-Name: None May 26 12:53:29.232837 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Identity-Status: Confirmed May 26 12:53:29.232837 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Is-Admin-Project: True May 26 12:53:29.232837 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Project-Domain-Id: default May 26 12:53:29.232837 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Project-Domain-Name: Default May 26 12:53:29.232837 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Project-Id: cad768b45d17480d8d6bbbcff6032c8d May 26 12:53:29.232837 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Project-Name: tempest-AttachVolumeNegativeTest-155076248 May 26 12:53:29.232837 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Role: member,reader May 26 12:53:29.232837 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Roles: member,reader May 26 12:53:29.234897 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/cad768b45d17480d8d6bbbcff6032c8d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/cad768b45d17480d8d6bbbcff6032c8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/cad768b45d17480d8d6bbbcff6032c8d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_cad768b45d17480d8d6bbbcff6032c8d", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 26 12:53:29.234897 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Tenant: tempest-AttachVolumeNegativeTest-155076248 May 26 12:53:29.234897 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Tenant-Id: cad768b45d17480d8d6bbbcff6032c8d May 26 12:53:29.234897 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-155076248 May 26 12:53:29.234897 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User: tempest-AttachVolumeNegativeTest-155076248-project May 26 12:53:29.234897 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User-Domain-Id: default May 26 12:53:29.234897 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User-Domain-Name: Default May 26 12:53:29.234897 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User-Id: 0537911b91184fcdbdcc9e93ec3fe5b9 May 26 12:53:29.234897 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User-Name: tempest-AttachVolumeNegativeTest-155076248-project May 26 12:53:29.234897 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: method: > May 26 12:53:29.234897 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: exception: Instance 77ecf3b8-40c2-4eff-ac61-fca2cedc1446 could not be found. May 26 12:53:29.234897 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: action_args: {'id': '77ecf3b8-40c2-4eff-ac61-fca2cedc1446'} May 26 12:53:29.235629 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:53:29.235629 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:53:29.235629 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:53:29.235629 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:53:29.235629 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:53:29.235629 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:53:29.235629 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:53:29.235629 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:53:29.235629 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:53:29.235629 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:53:29.235629 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77ecf3b8-40c2-4eff-ac61-fca2cedc1446 could not be found. May 26 12:53:29.235629 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:53:29.235629 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:53:29.235629 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:53:29.235629 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:53:29.235629 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:53:29.235629 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:53:29.235629 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:53:29.235629 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:53:29.235629 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:53:29.237024 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:53:29.237024 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 12:53:29.237024 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 12:53:29.237024 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:53:29.237024 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:53:29.237024 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:53:29.237024 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:53:29.237024 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77ecf3b8-40c2-4eff-ac61-fca2cedc1446 could not be found. May 26 12:53:29.237024 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:53:29.237024 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:53:29.237024 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:53:29.237024 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:53:29.237024 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:53:29.237024 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:53:29.237024 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:53:29.237024 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:53:29.237024 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77ecf3b8-40c2-4eff-ac61-fca2cedc1446 could not be found. May 26 12:53:29.237024 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:53:29.239149 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-01784685-def9-4c91-b30c-77587e944b10 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Returning 404 to user: Instance 77ecf3b8-40c2-4eff-ac61-fca2cedc1446 could not be found. {{(pid=124823) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:53:29.239149 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-01784685-def9-4c91-b30c-77587e944b10 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "GET /compute/v2.1/servers/77ecf3b8-40c2-4eff-ac61-fca2cedc1446" status: 404 len: 111 microversion: 2.1 time: 0.037720 May 26 12:53:29.239149 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 368/728] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:53:29 2022] GET /compute/v2.1/servers/77ecf3b8-40c2-4eff-ac61-fca2cedc1446 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:53:29.244403 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-39230e65-3b68-4228-8787-e0aab28c98ca tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '.version_select at 0x7f26a1dadf70>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:29.317643 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-39230e65-3b68-4228-8787-e0aab28c98ca tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1542808163" status: 202 len: 0 microversion: 2.1 time: 0.077304 May 26 12:53:29.318635 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 361/729] 10.222.0.41 () {58 vars in 1220 bytes} [Thu May 26 12:53:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1542808163 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 26 12:53:30.296585 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-9f1fc5d1-baeb-45a7-8970-7e3756ce3b8e tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:30.297630 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-9f1fc5d1-baeb-45a7-8970-7e3756ce3b8e tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 73592c9c-6dae-4521-a03d-e02749530cac] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:30.305150 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-9f1fc5d1-baeb-45a7-8970-7e3756ce3b8e tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:30.305596 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-9f1fc5d1-baeb-45a7-8970-7e3756ce3b8e tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:30.306585 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-9f1fc5d1-baeb-45a7-8970-7e3756ce3b8e tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:30.307098 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-9f1fc5d1-baeb-45a7-8970-7e3756ce3b8e tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:30.341233 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-9f1fc5d1-baeb-45a7-8970-7e3756ce3b8e tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.049756 May 26 12:53:30.341861 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 369/730] 10.222.0.41 () {60 vars in 1342 bytes} [Thu May 26 12:53:30 2022] GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:53:30.401944 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-34c9a3aa-ecef-4f32-bd80-00d041c1d47b tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:30.402447 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-34c9a3aa-ecef-4f32-bd80-00d041c1d47b tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 73592c9c-6dae-4521-a03d-e02749530cac] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:30.409239 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-34c9a3aa-ecef-4f32-bd80-00d041c1d47b tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:30.409715 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-34c9a3aa-ecef-4f32-bd80-00d041c1d47b tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:30.410487 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-34c9a3aa-ecef-4f32-bd80-00d041c1d47b tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:30.410921 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-34c9a3aa-ecef-4f32-bd80-00d041c1d47b tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:30.439003 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-34c9a3aa-ecef-4f32-bd80-00d041c1d47b tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 73592c9c-6dae-4521-a03d-e02749530cac] Going to try to terminate instance {{(pid=124824) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 12:53:30.899792 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-34c9a3aa-ecef-4f32-bd80-00d041c1d47b tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "DELETE /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac" status: 204 len: 0 microversion: 2.20 time: 0.502075 May 26 12:53:30.905247 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 362/731] 10.222.0.41 () {60 vars in 1279 bytes} [Thu May 26 12:53:30 2022] DELETE /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac => generated 0 bytes in 508 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 26 12:53:30.914033 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-6c3f0fb8-47ad-4797-9c4a-0f14d66aa290 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:30.914896 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-6c3f0fb8-47ad-4797-9c4a-0f14d66aa290 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 73592c9c-6dae-4521-a03d-e02749530cac] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:30.924274 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-6c3f0fb8-47ad-4797-9c4a-0f14d66aa290 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:30.924815 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-6c3f0fb8-47ad-4797-9c4a-0f14d66aa290 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:30.925693 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-6c3f0fb8-47ad-4797-9c4a-0f14d66aa290 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:30.926216 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-6c3f0fb8-47ad-4797-9c4a-0f14d66aa290 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:31.094271 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-6c3f0fb8-47ad-4797-9c4a-0f14d66aa290 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:31.104334 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-6c3f0fb8-47ad-4797-9c4a-0f14d66aa290 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:31.106293 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-6c3f0fb8-47ad-4797-9c4a-0f14d66aa290 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:31.109369 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-6c3f0fb8-47ad-4797-9c4a-0f14d66aa290 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac" status: 200 len: 1725 microversion: 2.20 time: 0.198522 May 26 12:53:31.109369 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 370/732] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:53:30 2022] GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac => generated 1725 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:53:31.869094 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-cf313355-3546-481a-8483-5a1986fa6ab8 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:31.870337 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-cf313355-3546-481a-8483-5a1986fa6ab8 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: 77ecf3b8-40c2-4eff-ac61-fca2cedc1446] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:31.878537 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-cf313355-3546-481a-8483-5a1986fa6ab8 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:31.879359 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-cf313355-3546-481a-8483-5a1986fa6ab8 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:31.880340 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-cf313355-3546-481a-8483-5a1986fa6ab8 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:31.880940 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-cf313355-3546-481a-8483-5a1986fa6ab8 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:31.896902 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.wsgi [None req-cf313355-3546-481a-8483-5a1986fa6ab8 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] HTTP exception thrown: Instance 77ecf3b8-40c2-4eff-ac61-fca2cedc1446 could not be found. May 26 12:53:31.898745 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-cf313355-3546-481a-8483-5a1986fa6ab8 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Request method failure captured: May 26 12:53:31.898745 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: request: DELETE /compute/v2.1/servers/77ecf3b8-40c2-4eff-ac61-fca2cedc1446 HTTP/1.1 May 26 12:53:31.898745 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Accept: application/json May 26 12:53:31.898745 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Accept-Encoding: identity May 26 12:53:31.898745 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Connection: close May 26 12:53:31.898745 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Content-Length: 0 May 26 12:53:31.898745 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Content-Type: application/json May 26 12:53:31.898745 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Host: 10.222.0.41 May 26 12:53:31.898745 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Openstack-System-Scope: None May 26 12:53:31.898745 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: User-Agent: python-urllib3/1.26.9 May 26 12:53:31.898745 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Auth-Token: gAAAAABij3aYTDT6d91IIen8MNgNrsA0ohBGn_dUC2tsponOFwNurwjlknBmFB36blSobobmDRibGa26en17LZfjuhgOSZiQsswJxea6OZWaEAKHfDkIbtu7XpKpGW-ZBZHCz2dZb9rYCBos_UyGkZJY7k8n757Ijkdz5EguRL9a0MDFor49yAU May 26 12:53:31.898745 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Domain-Id: None May 26 12:53:31.898745 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Domain-Name: None May 26 12:53:31.898745 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Identity-Status: Confirmed May 26 12:53:31.898745 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Is-Admin-Project: True May 26 12:53:31.898745 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Domain-Id: default May 26 12:53:31.898745 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Domain-Name: Default May 26 12:53:31.898745 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Id: cad768b45d17480d8d6bbbcff6032c8d May 26 12:53:31.898745 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Name: tempest-AttachVolumeNegativeTest-155076248 May 26 12:53:31.898745 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Role: member,reader May 26 12:53:31.898745 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Roles: member,reader May 26 12:53:31.900046 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/cad768b45d17480d8d6bbbcff6032c8d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/cad768b45d17480d8d6bbbcff6032c8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/cad768b45d17480d8d6bbbcff6032c8d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_cad768b45d17480d8d6bbbcff6032c8d", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 26 12:53:31.900046 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Tenant: tempest-AttachVolumeNegativeTest-155076248 May 26 12:53:31.900046 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Tenant-Id: cad768b45d17480d8d6bbbcff6032c8d May 26 12:53:31.900046 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-155076248 May 26 12:53:31.900046 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User: tempest-AttachVolumeNegativeTest-155076248-project May 26 12:53:31.900046 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Domain-Id: default May 26 12:53:31.900046 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Domain-Name: Default May 26 12:53:31.900046 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Id: 0537911b91184fcdbdcc9e93ec3fe5b9 May 26 12:53:31.900046 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Name: tempest-AttachVolumeNegativeTest-155076248-project May 26 12:53:31.900046 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: method: > May 26 12:53:31.900046 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: exception: Instance 77ecf3b8-40c2-4eff-ac61-fca2cedc1446 could not be found. May 26 12:53:31.900046 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: action_args: {'id': '77ecf3b8-40c2-4eff-ac61-fca2cedc1446'} May 26 12:53:31.903229 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:53:31.903229 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:53:31.903229 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:53:31.903229 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:53:31.903229 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:53:31.903229 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:53:31.903229 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:53:31.903229 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:53:31.903229 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:53:31.903229 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:53:31.903229 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77ecf3b8-40c2-4eff-ac61-fca2cedc1446 could not be found. May 26 12:53:31.903229 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:53:31.903229 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:53:31.903229 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:53:31.903229 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:53:31.903229 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:53:31.903229 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:53:31.903229 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:53:31.903229 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:53:31.903229 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:53:31.905005 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:53:31.905005 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 12:53:31.905005 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 12:53:31.905005 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 12:53:31.905005 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 12:53:31.905005 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:53:31.905005 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:53:31.905005 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:53:31.905005 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:53:31.905005 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77ecf3b8-40c2-4eff-ac61-fca2cedc1446 could not be found. May 26 12:53:31.905005 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:53:31.905005 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:53:31.905005 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:53:31.905005 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:53:31.905005 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:53:31.905005 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:53:31.905005 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:53:31.905005 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:53:31.905005 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77ecf3b8-40c2-4eff-ac61-fca2cedc1446 could not be found. May 26 12:53:31.905005 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:53:31.907457 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-cf313355-3546-481a-8483-5a1986fa6ab8 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Returning 404 to user: Instance 77ecf3b8-40c2-4eff-ac61-fca2cedc1446 could not be found. {{(pid=124824) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:53:31.907457 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-cf313355-3546-481a-8483-5a1986fa6ab8 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "DELETE /compute/v2.1/servers/77ecf3b8-40c2-4eff-ac61-fca2cedc1446" status: 404 len: 111 microversion: 2.1 time: 0.036005 May 26 12:53:31.907457 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 363/733] 10.222.0.41 () {58 vars in 1238 bytes} [Thu May 26 12:53:31 2022] DELETE /compute/v2.1/servers/77ecf3b8-40c2-4eff-ac61-fca2cedc1446 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:53:31.908988 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-7593526d-a004-4daf-80b9-e4ba4407b27e tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:31.909621 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-7593526d-a004-4daf-80b9-e4ba4407b27e tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: 77ecf3b8-40c2-4eff-ac61-fca2cedc1446] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:31.916538 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-7593526d-a004-4daf-80b9-e4ba4407b27e tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:31.917220 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-7593526d-a004-4daf-80b9-e4ba4407b27e tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:31.918530 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-7593526d-a004-4daf-80b9-e4ba4407b27e tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:31.921804 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-7593526d-a004-4daf-80b9-e4ba4407b27e tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:31.937468 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.wsgi [None req-7593526d-a004-4daf-80b9-e4ba4407b27e tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] HTTP exception thrown: Instance 77ecf3b8-40c2-4eff-ac61-fca2cedc1446 could not be found. May 26 12:53:31.939167 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-7593526d-a004-4daf-80b9-e4ba4407b27e tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Request method failure captured: May 26 12:53:31.939167 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: request: GET /compute/v2.1/servers/77ecf3b8-40c2-4eff-ac61-fca2cedc1446 HTTP/1.1 May 26 12:53:31.939167 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Accept: application/json May 26 12:53:31.939167 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Accept-Encoding: identity May 26 12:53:31.939167 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Connection: close May 26 12:53:31.939167 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Content-Length: 0 May 26 12:53:31.939167 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Content-Type: application/json May 26 12:53:31.939167 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Host: 10.222.0.41 May 26 12:53:31.939167 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Openstack-System-Scope: None May 26 12:53:31.939167 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: User-Agent: python-urllib3/1.26.9 May 26 12:53:31.939167 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Auth-Token: gAAAAABij3aYTDT6d91IIen8MNgNrsA0ohBGn_dUC2tsponOFwNurwjlknBmFB36blSobobmDRibGa26en17LZfjuhgOSZiQsswJxea6OZWaEAKHfDkIbtu7XpKpGW-ZBZHCz2dZb9rYCBos_UyGkZJY7k8n757Ijkdz5EguRL9a0MDFor49yAU May 26 12:53:31.939167 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Domain-Id: None May 26 12:53:31.939167 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Domain-Name: None May 26 12:53:31.939167 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Identity-Status: Confirmed May 26 12:53:31.939167 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Is-Admin-Project: True May 26 12:53:31.939167 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Project-Domain-Id: default May 26 12:53:31.939167 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Project-Domain-Name: Default May 26 12:53:31.939167 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Project-Id: cad768b45d17480d8d6bbbcff6032c8d May 26 12:53:31.939167 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Project-Name: tempest-AttachVolumeNegativeTest-155076248 May 26 12:53:31.939167 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Role: member,reader May 26 12:53:31.939167 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Roles: member,reader May 26 12:53:31.940697 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/cad768b45d17480d8d6bbbcff6032c8d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/cad768b45d17480d8d6bbbcff6032c8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/cad768b45d17480d8d6bbbcff6032c8d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_cad768b45d17480d8d6bbbcff6032c8d", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 26 12:53:31.940697 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Tenant: tempest-AttachVolumeNegativeTest-155076248 May 26 12:53:31.940697 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Tenant-Id: cad768b45d17480d8d6bbbcff6032c8d May 26 12:53:31.940697 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-155076248 May 26 12:53:31.940697 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User: tempest-AttachVolumeNegativeTest-155076248-project May 26 12:53:31.940697 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User-Domain-Id: default May 26 12:53:31.940697 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User-Domain-Name: Default May 26 12:53:31.940697 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User-Id: 0537911b91184fcdbdcc9e93ec3fe5b9 May 26 12:53:31.940697 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User-Name: tempest-AttachVolumeNegativeTest-155076248-project May 26 12:53:31.940697 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: method: > May 26 12:53:31.940697 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: exception: Instance 77ecf3b8-40c2-4eff-ac61-fca2cedc1446 could not be found. May 26 12:53:31.940697 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: action_args: {'id': '77ecf3b8-40c2-4eff-ac61-fca2cedc1446'} May 26 12:53:31.941547 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:53:31.941547 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:53:31.941547 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:53:31.941547 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:53:31.941547 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:53:31.941547 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:53:31.941547 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:53:31.941547 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:53:31.941547 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:53:31.941547 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:53:31.941547 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77ecf3b8-40c2-4eff-ac61-fca2cedc1446 could not be found. May 26 12:53:31.941547 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:53:31.941547 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:53:31.941547 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:53:31.941547 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:53:31.941547 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:53:31.941547 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:53:31.941547 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:53:31.941547 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:53:31.941547 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:53:31.944114 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:53:31.944114 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 12:53:31.944114 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 12:53:31.944114 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:53:31.944114 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:53:31.944114 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:53:31.944114 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:53:31.944114 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77ecf3b8-40c2-4eff-ac61-fca2cedc1446 could not be found. May 26 12:53:31.944114 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:53:31.944114 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:53:31.944114 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:53:31.944114 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:53:31.944114 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:53:31.944114 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:53:31.944114 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:53:31.944114 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:53:31.944114 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77ecf3b8-40c2-4eff-ac61-fca2cedc1446 could not be found. May 26 12:53:31.944114 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:53:31.946136 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-7593526d-a004-4daf-80b9-e4ba4407b27e tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Returning 404 to user: Instance 77ecf3b8-40c2-4eff-ac61-fca2cedc1446 could not be found. {{(pid=124823) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:53:31.947190 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-7593526d-a004-4daf-80b9-e4ba4407b27e tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "GET /compute/v2.1/servers/77ecf3b8-40c2-4eff-ac61-fca2cedc1446" status: 404 len: 111 microversion: 2.1 time: 0.042004 May 26 12:53:31.947760 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 371/734] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:53:31 2022] GET /compute/v2.1/servers/77ecf3b8-40c2-4eff-ac61-fca2cedc1446 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:53:32.132492 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-c384f647-bd3d-4614-b79e-c4529855fc28 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:32.133098 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-c384f647-bd3d-4614-b79e-c4529855fc28 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 73592c9c-6dae-4521-a03d-e02749530cac] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:32.140914 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-c384f647-bd3d-4614-b79e-c4529855fc28 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:32.141369 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-c384f647-bd3d-4614-b79e-c4529855fc28 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:32.142200 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-c384f647-bd3d-4614-b79e-c4529855fc28 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:32.142674 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-c384f647-bd3d-4614-b79e-c4529855fc28 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:32.306209 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-c384f647-bd3d-4614-b79e-c4529855fc28 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:32.316750 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-c384f647-bd3d-4614-b79e-c4529855fc28 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:32.318889 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-c384f647-bd3d-4614-b79e-c4529855fc28 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:32.321136 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-c384f647-bd3d-4614-b79e-c4529855fc28 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac" status: 200 len: 1725 microversion: 2.20 time: 0.195482 May 26 12:53:32.321136 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 364/735] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:53:32 2022] GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac => generated 1725 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:53:33.223871 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-5fef9c96-02b2-423d-99dd-68db4e358211 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:33.225167 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-5fef9c96-02b2-423d-99dd-68db4e358211 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: 1b2f404c-1ca9-4904-944c-16685c8f68c5] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:33.232597 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-5fef9c96-02b2-423d-99dd-68db4e358211 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:33.233179 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-5fef9c96-02b2-423d-99dd-68db4e358211 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:33.234088 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-5fef9c96-02b2-423d-99dd-68db4e358211 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:33.234783 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-5fef9c96-02b2-423d-99dd-68db4e358211 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:33.251624 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.wsgi [None req-5fef9c96-02b2-423d-99dd-68db4e358211 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] HTTP exception thrown: Instance 1b2f404c-1ca9-4904-944c-16685c8f68c5 could not be found. May 26 12:53:33.253506 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-5fef9c96-02b2-423d-99dd-68db4e358211 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Request method failure captured: May 26 12:53:33.253506 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: request: DELETE /compute/v2.1/servers/1b2f404c-1ca9-4904-944c-16685c8f68c5 HTTP/1.1 May 26 12:53:33.253506 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Accept: application/json May 26 12:53:33.253506 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Accept-Encoding: identity May 26 12:53:33.253506 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Connection: close May 26 12:53:33.253506 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Content-Length: 0 May 26 12:53:33.253506 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Content-Type: application/json May 26 12:53:33.253506 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Host: 10.222.0.41 May 26 12:53:33.253506 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Openstack-System-Scope: None May 26 12:53:33.253506 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: User-Agent: python-urllib3/1.26.9 May 26 12:53:33.253506 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Auth-Token: gAAAAABij3aYTDT6d91IIen8MNgNrsA0ohBGn_dUC2tsponOFwNurwjlknBmFB36blSobobmDRibGa26en17LZfjuhgOSZiQsswJxea6OZWaEAKHfDkIbtu7XpKpGW-ZBZHCz2dZb9rYCBos_UyGkZJY7k8n757Ijkdz5EguRL9a0MDFor49yAU May 26 12:53:33.253506 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Domain-Id: None May 26 12:53:33.253506 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Domain-Name: None May 26 12:53:33.253506 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Identity-Status: Confirmed May 26 12:53:33.253506 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Is-Admin-Project: True May 26 12:53:33.253506 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Project-Domain-Id: default May 26 12:53:33.253506 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Project-Domain-Name: Default May 26 12:53:33.253506 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Project-Id: cad768b45d17480d8d6bbbcff6032c8d May 26 12:53:33.253506 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Project-Name: tempest-AttachVolumeNegativeTest-155076248 May 26 12:53:33.253506 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Role: member,reader May 26 12:53:33.253506 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Roles: member,reader May 26 12:53:33.254878 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/cad768b45d17480d8d6bbbcff6032c8d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/cad768b45d17480d8d6bbbcff6032c8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/cad768b45d17480d8d6bbbcff6032c8d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_cad768b45d17480d8d6bbbcff6032c8d", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 26 12:53:33.254878 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Tenant: tempest-AttachVolumeNegativeTest-155076248 May 26 12:53:33.254878 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Tenant-Id: cad768b45d17480d8d6bbbcff6032c8d May 26 12:53:33.254878 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-155076248 May 26 12:53:33.254878 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User: tempest-AttachVolumeNegativeTest-155076248-project May 26 12:53:33.254878 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User-Domain-Id: default May 26 12:53:33.254878 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User-Domain-Name: Default May 26 12:53:33.254878 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User-Id: 0537911b91184fcdbdcc9e93ec3fe5b9 May 26 12:53:33.254878 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User-Name: tempest-AttachVolumeNegativeTest-155076248-project May 26 12:53:33.254878 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: method: > May 26 12:53:33.254878 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: exception: Instance 1b2f404c-1ca9-4904-944c-16685c8f68c5 could not be found. May 26 12:53:33.254878 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: action_args: {'id': '1b2f404c-1ca9-4904-944c-16685c8f68c5'} May 26 12:53:33.258966 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:53:33.258966 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:53:33.258966 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:53:33.258966 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:53:33.258966 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:53:33.258966 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:53:33.258966 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:53:33.258966 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:53:33.258966 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:53:33.258966 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:53:33.258966 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b2f404c-1ca9-4904-944c-16685c8f68c5 could not be found. May 26 12:53:33.258966 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:53:33.258966 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:53:33.258966 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:53:33.258966 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:53:33.258966 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:53:33.258966 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:53:33.258966 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:53:33.258966 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:53:33.258966 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:53:33.260244 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:53:33.260244 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 12:53:33.260244 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 12:53:33.260244 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 12:53:33.260244 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 12:53:33.260244 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:53:33.260244 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:53:33.260244 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:53:33.260244 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:53:33.260244 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b2f404c-1ca9-4904-944c-16685c8f68c5 could not be found. May 26 12:53:33.260244 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:53:33.260244 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:53:33.260244 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:53:33.260244 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:53:33.260244 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:53:33.260244 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:53:33.260244 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:53:33.260244 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:53:33.260244 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b2f404c-1ca9-4904-944c-16685c8f68c5 could not be found. May 26 12:53:33.260244 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:53:33.261475 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-5fef9c96-02b2-423d-99dd-68db4e358211 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Returning 404 to user: Instance 1b2f404c-1ca9-4904-944c-16685c8f68c5 could not be found. {{(pid=124823) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:53:33.261475 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-5fef9c96-02b2-423d-99dd-68db4e358211 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "DELETE /compute/v2.1/servers/1b2f404c-1ca9-4904-944c-16685c8f68c5" status: 404 len: 111 microversion: 2.1 time: 0.035441 May 26 12:53:33.261475 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 372/736] 10.222.0.41 () {58 vars in 1238 bytes} [Thu May 26 12:53:33 2022] DELETE /compute/v2.1/servers/1b2f404c-1ca9-4904-944c-16685c8f68c5 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:53:33.266633 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-d5cb6866-1b78-4a36-b0f9-8a4f2efdbd75 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:33.268180 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-d5cb6866-1b78-4a36-b0f9-8a4f2efdbd75 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: 1b2f404c-1ca9-4904-944c-16685c8f68c5] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:33.278677 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-d5cb6866-1b78-4a36-b0f9-8a4f2efdbd75 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:33.279128 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-d5cb6866-1b78-4a36-b0f9-8a4f2efdbd75 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:33.279950 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-d5cb6866-1b78-4a36-b0f9-8a4f2efdbd75 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:33.280393 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-d5cb6866-1b78-4a36-b0f9-8a4f2efdbd75 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:33.295224 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.wsgi [None req-d5cb6866-1b78-4a36-b0f9-8a4f2efdbd75 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] HTTP exception thrown: Instance 1b2f404c-1ca9-4904-944c-16685c8f68c5 could not be found. May 26 12:53:33.297884 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-d5cb6866-1b78-4a36-b0f9-8a4f2efdbd75 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Request method failure captured: May 26 12:53:33.297884 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: request: GET /compute/v2.1/servers/1b2f404c-1ca9-4904-944c-16685c8f68c5 HTTP/1.1 May 26 12:53:33.297884 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Accept: application/json May 26 12:53:33.297884 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Accept-Encoding: identity May 26 12:53:33.297884 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Connection: close May 26 12:53:33.297884 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Content-Length: 0 May 26 12:53:33.297884 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Content-Type: application/json May 26 12:53:33.297884 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Host: 10.222.0.41 May 26 12:53:33.297884 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Openstack-System-Scope: None May 26 12:53:33.297884 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: User-Agent: python-urllib3/1.26.9 May 26 12:53:33.297884 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Auth-Token: gAAAAABij3aYTDT6d91IIen8MNgNrsA0ohBGn_dUC2tsponOFwNurwjlknBmFB36blSobobmDRibGa26en17LZfjuhgOSZiQsswJxea6OZWaEAKHfDkIbtu7XpKpGW-ZBZHCz2dZb9rYCBos_UyGkZJY7k8n757Ijkdz5EguRL9a0MDFor49yAU May 26 12:53:33.297884 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Domain-Id: None May 26 12:53:33.297884 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Domain-Name: None May 26 12:53:33.297884 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Identity-Status: Confirmed May 26 12:53:33.297884 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Is-Admin-Project: True May 26 12:53:33.297884 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Domain-Id: default May 26 12:53:33.297884 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Domain-Name: Default May 26 12:53:33.297884 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Id: cad768b45d17480d8d6bbbcff6032c8d May 26 12:53:33.297884 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Name: tempest-AttachVolumeNegativeTest-155076248 May 26 12:53:33.297884 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Role: member,reader May 26 12:53:33.297884 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Roles: member,reader May 26 12:53:33.299186 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/cad768b45d17480d8d6bbbcff6032c8d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/cad768b45d17480d8d6bbbcff6032c8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/cad768b45d17480d8d6bbbcff6032c8d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_cad768b45d17480d8d6bbbcff6032c8d", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 26 12:53:33.299186 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Tenant: tempest-AttachVolumeNegativeTest-155076248 May 26 12:53:33.299186 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Tenant-Id: cad768b45d17480d8d6bbbcff6032c8d May 26 12:53:33.299186 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-155076248 May 26 12:53:33.299186 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User: tempest-AttachVolumeNegativeTest-155076248-project May 26 12:53:33.299186 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Domain-Id: default May 26 12:53:33.299186 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Domain-Name: Default May 26 12:53:33.299186 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Id: 0537911b91184fcdbdcc9e93ec3fe5b9 May 26 12:53:33.299186 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Name: tempest-AttachVolumeNegativeTest-155076248-project May 26 12:53:33.299186 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: method: > May 26 12:53:33.299186 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: exception: Instance 1b2f404c-1ca9-4904-944c-16685c8f68c5 could not be found. May 26 12:53:33.299186 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: action_args: {'id': '1b2f404c-1ca9-4904-944c-16685c8f68c5'} May 26 12:53:33.303518 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:53:33.303518 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:53:33.303518 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:53:33.303518 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:53:33.303518 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:53:33.303518 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:53:33.303518 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:53:33.303518 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:53:33.303518 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:53:33.303518 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:53:33.303518 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b2f404c-1ca9-4904-944c-16685c8f68c5 could not be found. May 26 12:53:33.303518 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:53:33.303518 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:53:33.303518 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:53:33.303518 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:53:33.303518 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:53:33.303518 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:53:33.303518 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:53:33.303518 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:53:33.303518 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:53:33.304843 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:53:33.304843 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 12:53:33.304843 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 12:53:33.304843 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:53:33.304843 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:53:33.304843 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:53:33.304843 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:53:33.304843 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b2f404c-1ca9-4904-944c-16685c8f68c5 could not be found. May 26 12:53:33.304843 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:53:33.304843 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:53:33.304843 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:53:33.304843 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:53:33.304843 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:53:33.304843 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:53:33.304843 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:53:33.304843 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:53:33.304843 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b2f404c-1ca9-4904-944c-16685c8f68c5 could not be found. May 26 12:53:33.304843 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:53:33.308002 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-d5cb6866-1b78-4a36-b0f9-8a4f2efdbd75 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Returning 404 to user: Instance 1b2f404c-1ca9-4904-944c-16685c8f68c5 could not be found. {{(pid=124824) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:53:33.308002 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-d5cb6866-1b78-4a36-b0f9-8a4f2efdbd75 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "GET /compute/v2.1/servers/1b2f404c-1ca9-4904-944c-16685c8f68c5" status: 404 len: 111 microversion: 2.1 time: 0.038533 May 26 12:53:33.308002 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 365/737] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:53:33 2022] GET /compute/v2.1/servers/1b2f404c-1ca9-4904-944c-16685c8f68c5 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:53:33.314264 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-cf32e03e-6039-4648-8ec4-01a9bb843e5a tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:33.314797 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-cf32e03e-6039-4648-8ec4-01a9bb843e5a tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: d6056156-21c7-47e2-9303-f90a8ec1b474] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:33.321167 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-cf32e03e-6039-4648-8ec4-01a9bb843e5a tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:33.321614 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-cf32e03e-6039-4648-8ec4-01a9bb843e5a tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:33.322465 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-cf32e03e-6039-4648-8ec4-01a9bb843e5a tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:33.323245 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-cf32e03e-6039-4648-8ec4-01a9bb843e5a tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:33.338040 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.wsgi [None req-cf32e03e-6039-4648-8ec4-01a9bb843e5a tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] HTTP exception thrown: Instance d6056156-21c7-47e2-9303-f90a8ec1b474 could not be found. May 26 12:53:33.340081 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-05128d32-a186-4976-aa8d-53307e869864 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:33.340256 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-cf32e03e-6039-4648-8ec4-01a9bb843e5a tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Request method failure captured: May 26 12:53:33.340256 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: request: DELETE /compute/v2.1/servers/d6056156-21c7-47e2-9303-f90a8ec1b474 HTTP/1.1 May 26 12:53:33.340256 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Accept: application/json May 26 12:53:33.340256 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Accept-Encoding: identity May 26 12:53:33.340256 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Connection: close May 26 12:53:33.340256 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Content-Length: 0 May 26 12:53:33.340256 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Content-Type: application/json May 26 12:53:33.340256 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Host: 10.222.0.41 May 26 12:53:33.340256 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Openstack-System-Scope: None May 26 12:53:33.340256 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: User-Agent: python-urllib3/1.26.9 May 26 12:53:33.340256 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Auth-Token: gAAAAABij3aYTDT6d91IIen8MNgNrsA0ohBGn_dUC2tsponOFwNurwjlknBmFB36blSobobmDRibGa26en17LZfjuhgOSZiQsswJxea6OZWaEAKHfDkIbtu7XpKpGW-ZBZHCz2dZb9rYCBos_UyGkZJY7k8n757Ijkdz5EguRL9a0MDFor49yAU May 26 12:53:33.340256 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Domain-Id: None May 26 12:53:33.340256 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Domain-Name: None May 26 12:53:33.340256 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Identity-Status: Confirmed May 26 12:53:33.340256 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Is-Admin-Project: True May 26 12:53:33.340256 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Project-Domain-Id: default May 26 12:53:33.340256 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Project-Domain-Name: Default May 26 12:53:33.340256 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Project-Id: cad768b45d17480d8d6bbbcff6032c8d May 26 12:53:33.340256 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Project-Name: tempest-AttachVolumeNegativeTest-155076248 May 26 12:53:33.340256 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Role: member,reader May 26 12:53:33.340256 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Roles: member,reader May 26 12:53:33.341787 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/cad768b45d17480d8d6bbbcff6032c8d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/cad768b45d17480d8d6bbbcff6032c8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/cad768b45d17480d8d6bbbcff6032c8d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_cad768b45d17480d8d6bbbcff6032c8d", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 26 12:53:33.341787 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Tenant: tempest-AttachVolumeNegativeTest-155076248 May 26 12:53:33.341787 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Tenant-Id: cad768b45d17480d8d6bbbcff6032c8d May 26 12:53:33.341787 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-155076248 May 26 12:53:33.341787 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User: tempest-AttachVolumeNegativeTest-155076248-project May 26 12:53:33.341787 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User-Domain-Id: default May 26 12:53:33.341787 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User-Domain-Name: Default May 26 12:53:33.341787 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User-Id: 0537911b91184fcdbdcc9e93ec3fe5b9 May 26 12:53:33.341787 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User-Name: tempest-AttachVolumeNegativeTest-155076248-project May 26 12:53:33.341787 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: method: > May 26 12:53:33.341787 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: exception: Instance d6056156-21c7-47e2-9303-f90a8ec1b474 could not be found. May 26 12:53:33.341787 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: action_args: {'id': 'd6056156-21c7-47e2-9303-f90a8ec1b474'} May 26 12:53:33.342636 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:53:33.342636 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:53:33.342636 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:53:33.342636 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:53:33.342636 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:53:33.342636 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:53:33.342636 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:53:33.342636 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:53:33.342636 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:53:33.342636 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:53:33.342636 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6056156-21c7-47e2-9303-f90a8ec1b474 could not be found. May 26 12:53:33.342636 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:53:33.342636 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:53:33.342636 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:53:33.342636 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:53:33.342636 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:53:33.342636 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:53:33.342636 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:53:33.342636 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:53:33.342636 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:53:33.343994 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:53:33.343994 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 12:53:33.343994 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 12:53:33.343994 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 12:53:33.343994 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 12:53:33.343994 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:53:33.343994 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:53:33.343994 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:53:33.343994 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:53:33.343994 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6056156-21c7-47e2-9303-f90a8ec1b474 could not be found. May 26 12:53:33.343994 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:53:33.343994 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:53:33.343994 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:53:33.343994 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:53:33.343994 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:53:33.343994 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:53:33.343994 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:53:33.343994 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:53:33.343994 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6056156-21c7-47e2-9303-f90a8ec1b474 could not be found. May 26 12:53:33.343994 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:53:33.345369 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-05128d32-a186-4976-aa8d-53307e869864 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 73592c9c-6dae-4521-a03d-e02749530cac] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:33.345473 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-cf32e03e-6039-4648-8ec4-01a9bb843e5a tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Returning 404 to user: Instance d6056156-21c7-47e2-9303-f90a8ec1b474 could not be found. {{(pid=124823) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:53:33.345473 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-cf32e03e-6039-4648-8ec4-01a9bb843e5a tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "DELETE /compute/v2.1/servers/d6056156-21c7-47e2-9303-f90a8ec1b474" status: 404 len: 111 microversion: 2.1 time: 0.033258 May 26 12:53:33.345473 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 373/738] 10.222.0.41 () {58 vars in 1238 bytes} [Thu May 26 12:53:33 2022] DELETE /compute/v2.1/servers/d6056156-21c7-47e2-9303-f90a8ec1b474 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:53:33.348164 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-05128d32-a186-4976-aa8d-53307e869864 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:33.348164 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-05128d32-a186-4976-aa8d-53307e869864 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:33.348917 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-05128d32-a186-4976-aa8d-53307e869864 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:33.349653 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-05128d32-a186-4976-aa8d-53307e869864 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:33.353781 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-37ef930d-9b8b-4ceb-8049-7e320b8fe056 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:33.353781 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-37ef930d-9b8b-4ceb-8049-7e320b8fe056 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: d6056156-21c7-47e2-9303-f90a8ec1b474] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:33.361457 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-37ef930d-9b8b-4ceb-8049-7e320b8fe056 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:33.362172 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-37ef930d-9b8b-4ceb-8049-7e320b8fe056 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:33.363227 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-37ef930d-9b8b-4ceb-8049-7e320b8fe056 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:33.363812 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-37ef930d-9b8b-4ceb-8049-7e320b8fe056 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:33.383593 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.wsgi [None req-37ef930d-9b8b-4ceb-8049-7e320b8fe056 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] HTTP exception thrown: Instance d6056156-21c7-47e2-9303-f90a8ec1b474 could not be found. May 26 12:53:33.385463 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-37ef930d-9b8b-4ceb-8049-7e320b8fe056 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Request method failure captured: May 26 12:53:33.385463 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: request: GET /compute/v2.1/servers/d6056156-21c7-47e2-9303-f90a8ec1b474 HTTP/1.1 May 26 12:53:33.385463 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Accept: application/json May 26 12:53:33.385463 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Accept-Encoding: identity May 26 12:53:33.385463 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Connection: close May 26 12:53:33.385463 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Content-Length: 0 May 26 12:53:33.385463 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Content-Type: application/json May 26 12:53:33.385463 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Host: 10.222.0.41 May 26 12:53:33.385463 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Openstack-System-Scope: None May 26 12:53:33.385463 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: User-Agent: python-urllib3/1.26.9 May 26 12:53:33.385463 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Auth-Token: gAAAAABij3aYTDT6d91IIen8MNgNrsA0ohBGn_dUC2tsponOFwNurwjlknBmFB36blSobobmDRibGa26en17LZfjuhgOSZiQsswJxea6OZWaEAKHfDkIbtu7XpKpGW-ZBZHCz2dZb9rYCBos_UyGkZJY7k8n757Ijkdz5EguRL9a0MDFor49yAU May 26 12:53:33.385463 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Domain-Id: None May 26 12:53:33.385463 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Domain-Name: None May 26 12:53:33.385463 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Identity-Status: Confirmed May 26 12:53:33.385463 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Is-Admin-Project: True May 26 12:53:33.385463 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Project-Domain-Id: default May 26 12:53:33.385463 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Project-Domain-Name: Default May 26 12:53:33.385463 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Project-Id: cad768b45d17480d8d6bbbcff6032c8d May 26 12:53:33.385463 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Project-Name: tempest-AttachVolumeNegativeTest-155076248 May 26 12:53:33.385463 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Role: member,reader May 26 12:53:33.385463 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Roles: member,reader May 26 12:53:33.387370 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/cad768b45d17480d8d6bbbcff6032c8d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/cad768b45d17480d8d6bbbcff6032c8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/cad768b45d17480d8d6bbbcff6032c8d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_cad768b45d17480d8d6bbbcff6032c8d", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 26 12:53:33.387370 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Tenant: tempest-AttachVolumeNegativeTest-155076248 May 26 12:53:33.387370 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Tenant-Id: cad768b45d17480d8d6bbbcff6032c8d May 26 12:53:33.387370 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-155076248 May 26 12:53:33.387370 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User: tempest-AttachVolumeNegativeTest-155076248-project May 26 12:53:33.387370 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User-Domain-Id: default May 26 12:53:33.387370 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User-Domain-Name: Default May 26 12:53:33.387370 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User-Id: 0537911b91184fcdbdcc9e93ec3fe5b9 May 26 12:53:33.387370 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User-Name: tempest-AttachVolumeNegativeTest-155076248-project May 26 12:53:33.387370 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: method: > May 26 12:53:33.387370 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: exception: Instance d6056156-21c7-47e2-9303-f90a8ec1b474 could not be found. May 26 12:53:33.387370 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: action_args: {'id': 'd6056156-21c7-47e2-9303-f90a8ec1b474'} May 26 12:53:33.388319 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:53:33.388319 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:53:33.388319 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:53:33.388319 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:53:33.388319 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:53:33.388319 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:53:33.388319 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:53:33.388319 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:53:33.388319 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:53:33.388319 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:53:33.388319 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6056156-21c7-47e2-9303-f90a8ec1b474 could not be found. May 26 12:53:33.388319 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:53:33.388319 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:53:33.388319 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:53:33.388319 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:53:33.388319 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:53:33.388319 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:53:33.388319 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:53:33.388319 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:53:33.388319 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:53:33.389483 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:53:33.389483 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 12:53:33.389483 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 12:53:33.389483 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:53:33.389483 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:53:33.389483 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:53:33.389483 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:53:33.389483 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6056156-21c7-47e2-9303-f90a8ec1b474 could not be found. May 26 12:53:33.389483 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:53:33.389483 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:53:33.389483 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:53:33.389483 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:53:33.389483 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:53:33.389483 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:53:33.389483 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:53:33.389483 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:53:33.389483 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6056156-21c7-47e2-9303-f90a8ec1b474 could not be found. May 26 12:53:33.389483 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:53:33.390833 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-37ef930d-9b8b-4ceb-8049-7e320b8fe056 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Returning 404 to user: Instance d6056156-21c7-47e2-9303-f90a8ec1b474 could not be found. {{(pid=124823) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:53:33.390833 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-37ef930d-9b8b-4ceb-8049-7e320b8fe056 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "GET /compute/v2.1/servers/d6056156-21c7-47e2-9303-f90a8ec1b474" status: 404 len: 111 microversion: 2.1 time: 0.039804 May 26 12:53:33.390833 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 374/739] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:53:33 2022] GET /compute/v2.1/servers/d6056156-21c7-47e2-9303-f90a8ec1b474 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:53:33.424970 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-05128d32-a186-4976-aa8d-53307e869864 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:33.434583 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-05128d32-a186-4976-aa8d-53307e869864 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:33.436765 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-05128d32-a186-4976-aa8d-53307e869864 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:33.443898 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-05128d32-a186-4976-aa8d-53307e869864 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac" status: 200 len: 1658 microversion: 2.20 time: 0.107743 May 26 12:53:33.444501 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 366/740] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:53:33 2022] GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac => generated 1658 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 12:53:33.492867 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [req-bd02c408-61a4-4ebf-aa59-e40c466baa86 req-eb9fe4bc-df89-4087-85e9-2c28fd1df4ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73592c9c-6dae-4521-a03d-e02749530cac", "name": "network-vif-deleted", "tag": "d2fc86c7-8d2d-4221-a19f-e4847de64091"}]} {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:53:33.503141 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [req-bd02c408-61a4-4ebf-aa59-e40c466baa86 req-eb9fe4bc-df89-4087-85e9-2c28fd1df4ab service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:33.503653 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [req-bd02c408-61a4-4ebf-aa59-e40c466baa86 req-eb9fe4bc-df89-4087-85e9-2c28fd1df4ab service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:33.516670 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.compute.server_external_events [req-bd02c408-61a4-4ebf-aa59-e40c466baa86 req-eb9fe4bc-df89-4087-85e9-2c28fd1df4ab service nova] Creating event network-vif-deleted:d2fc86c7-8d2d-4221-a19f-e4847de64091 for instance 73592c9c-6dae-4521-a03d-e02749530cac on hv-cinder-81571 May 26 12:53:33.522360 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [req-bd02c408-61a4-4ebf-aa59-e40c466baa86 req-eb9fe4bc-df89-4087-85e9-2c28fd1df4ab service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033070 May 26 12:53:33.523245 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 375/741] 10.222.0.41 () {64 vars in 1317 bytes} [Thu May 26 12:53:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:53:34.462485 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-e730406d-f32a-4c2f-a99c-f5c69c1f62bf tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:34.463167 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-e730406d-f32a-4c2f-a99c-f5c69c1f62bf tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 73592c9c-6dae-4521-a03d-e02749530cac] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:34.469912 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-e730406d-f32a-4c2f-a99c-f5c69c1f62bf tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:34.470365 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-e730406d-f32a-4c2f-a99c-f5c69c1f62bf tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:34.471407 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-e730406d-f32a-4c2f-a99c-f5c69c1f62bf tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:34.471847 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-e730406d-f32a-4c2f-a99c-f5c69c1f62bf tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:34.527184 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-e730406d-f32a-4c2f-a99c-f5c69c1f62bf tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:34.527184 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-e730406d-f32a-4c2f-a99c-f5c69c1f62bf tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:34.527184 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.objects.instance [None req-e730406d-f32a-4c2f-a99c-f5c69c1f62bf tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lazy-loading 'fault' on Instance uuid 73592c9c-6dae-4521-a03d-e02749530cac {{(pid=124824) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:53:34.556743 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-e730406d-f32a-4c2f-a99c-f5c69c1f62bf tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:34.563254 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-e730406d-f32a-4c2f-a99c-f5c69c1f62bf tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:34.564755 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-e730406d-f32a-4c2f-a99c-f5c69c1f62bf tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e83db01f0b24204a61b037b3c1f044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90e7edce8984d49b7bdebed2947b436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:34.566011 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-e730406d-f32a-4c2f-a99c-f5c69c1f62bf tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac" status: 200 len: 1372 microversion: 2.20 time: 0.107452 May 26 12:53:34.566684 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 367/742] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:53:34 2022] GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac => generated 1372 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 12:53:34.961810 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-87074c41-6d76-41da-b3b1-eccf62d0380c tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Action: 'create', calling method: .version_select at 0x7f26a1dd59d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-2109058780", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIvDe0wV0mwYLe2rWO4JO61zELfbT6ksyuGQi9CVjIds08AosKxOWQrBgUFxiLTCo6DxrFU/ofoIhs7l0wzaBDHPLd+s4hrBz5Hm0VwDWGjzKUFRV5FJNxlktCBiDtuYag=="}} {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:53:34.976209 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.quota [None req-87074c41-6d76-41da-b3b1-eccf62d0380c tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Getting quotas for project c876091609fe45ba80370a16748cbeb2. Resources: {'key_pairs'} {{(pid=124823) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:53:34.980235 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.quota [None req-87074c41-6d76-41da-b3b1-eccf62d0380c tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Getting quotas for user 7277aedb35df448e8b3056f8bc395e32 and project c876091609fe45ba80370a16748cbeb2. Resources: {'key_pairs'} {{(pid=124823) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:53:35.130236 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-87074c41-6d76-41da-b3b1-eccf62d0380c tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.173474 May 26 12:53:35.131282 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 376/743] 10.222.0.41 () {60 vars in 1158 bytes} [Thu May 26 12:53:34 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:53:35.160729 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-e70b7363-c539-4231-b37b-a9c9b9e19963 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:35.161386 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-e70b7363-c539-4231-b37b-a9c9b9e19963 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: 1a852e3a-0d2b-470a-a429-b4bac6aa8e6b] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:35.169194 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-e70b7363-c539-4231-b37b-a9c9b9e19963 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:35.169646 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-e70b7363-c539-4231-b37b-a9c9b9e19963 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:35.171036 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-e70b7363-c539-4231-b37b-a9c9b9e19963 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:35.171483 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-e70b7363-c539-4231-b37b-a9c9b9e19963 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:35.185285 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-d3cb8fa7-b9f7-43c9-aad9-311c9cc5fca8 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1104486552", "imageRef": "da4a92db-ecbf-4c08-83c9-50eebe42a9bb", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-2109058780", "networks": [{"uuid": "e0b5fd96-31c5-48b3-8169-c7d54d8a5fc3"}]}} {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:53:35.186362 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.wsgi [None req-e70b7363-c539-4231-b37b-a9c9b9e19963 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] HTTP exception thrown: Instance 1a852e3a-0d2b-470a-a429-b4bac6aa8e6b could not be found. May 26 12:53:35.187965 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-e70b7363-c539-4231-b37b-a9c9b9e19963 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Request method failure captured: May 26 12:53:35.187965 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: request: DELETE /compute/v2.1/servers/1a852e3a-0d2b-470a-a429-b4bac6aa8e6b HTTP/1.1 May 26 12:53:35.187965 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Accept: application/json May 26 12:53:35.187965 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Accept-Encoding: identity May 26 12:53:35.187965 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Connection: close May 26 12:53:35.187965 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Content-Length: 0 May 26 12:53:35.187965 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Content-Type: application/json May 26 12:53:35.187965 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Host: 10.222.0.41 May 26 12:53:35.187965 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Openstack-System-Scope: None May 26 12:53:35.187965 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: User-Agent: python-urllib3/1.26.9 May 26 12:53:35.187965 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Auth-Token: gAAAAABij3aYTDT6d91IIen8MNgNrsA0ohBGn_dUC2tsponOFwNurwjlknBmFB36blSobobmDRibGa26en17LZfjuhgOSZiQsswJxea6OZWaEAKHfDkIbtu7XpKpGW-ZBZHCz2dZb9rYCBos_UyGkZJY7k8n757Ijkdz5EguRL9a0MDFor49yAU May 26 12:53:35.187965 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Domain-Id: None May 26 12:53:35.187965 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Domain-Name: None May 26 12:53:35.187965 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Identity-Status: Confirmed May 26 12:53:35.187965 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Is-Admin-Project: True May 26 12:53:35.187965 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Domain-Id: default May 26 12:53:35.187965 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Domain-Name: Default May 26 12:53:35.187965 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Id: cad768b45d17480d8d6bbbcff6032c8d May 26 12:53:35.187965 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Name: tempest-AttachVolumeNegativeTest-155076248 May 26 12:53:35.187965 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Role: member,reader May 26 12:53:35.187965 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Roles: member,reader May 26 12:53:35.189918 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/cad768b45d17480d8d6bbbcff6032c8d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/cad768b45d17480d8d6bbbcff6032c8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/cad768b45d17480d8d6bbbcff6032c8d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_cad768b45d17480d8d6bbbcff6032c8d", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 26 12:53:35.189918 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Tenant: tempest-AttachVolumeNegativeTest-155076248 May 26 12:53:35.189918 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Tenant-Id: cad768b45d17480d8d6bbbcff6032c8d May 26 12:53:35.189918 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-155076248 May 26 12:53:35.189918 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User: tempest-AttachVolumeNegativeTest-155076248-project May 26 12:53:35.189918 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Domain-Id: default May 26 12:53:35.189918 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Domain-Name: Default May 26 12:53:35.189918 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Id: 0537911b91184fcdbdcc9e93ec3fe5b9 May 26 12:53:35.189918 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Name: tempest-AttachVolumeNegativeTest-155076248-project May 26 12:53:35.189918 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: method: > May 26 12:53:35.189918 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: exception: Instance 1a852e3a-0d2b-470a-a429-b4bac6aa8e6b could not be found. May 26 12:53:35.189918 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: action_args: {'id': '1a852e3a-0d2b-470a-a429-b4bac6aa8e6b'} May 26 12:53:35.190689 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:53:35.190689 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:53:35.190689 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:53:35.190689 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:53:35.190689 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:53:35.190689 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:53:35.190689 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:53:35.190689 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:53:35.190689 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:53:35.190689 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:53:35.190689 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a852e3a-0d2b-470a-a429-b4bac6aa8e6b could not be found. May 26 12:53:35.190689 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:53:35.190689 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:53:35.190689 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:53:35.190689 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:53:35.190689 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:53:35.190689 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:53:35.190689 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:53:35.190689 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:53:35.190689 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:53:35.192102 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:53:35.192102 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 12:53:35.192102 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 12:53:35.192102 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 12:53:35.192102 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 12:53:35.192102 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:53:35.192102 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:53:35.192102 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:53:35.192102 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:53:35.192102 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a852e3a-0d2b-470a-a429-b4bac6aa8e6b could not be found. May 26 12:53:35.192102 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:53:35.192102 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:53:35.192102 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:53:35.192102 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:53:35.192102 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:53:35.192102 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:53:35.192102 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:53:35.192102 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:53:35.192102 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a852e3a-0d2b-470a-a429-b4bac6aa8e6b could not be found. May 26 12:53:35.192102 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:53:35.193252 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-e70b7363-c539-4231-b37b-a9c9b9e19963 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Returning 404 to user: Instance 1a852e3a-0d2b-470a-a429-b4bac6aa8e6b could not be found. {{(pid=124824) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:53:35.193252 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-e70b7363-c539-4231-b37b-a9c9b9e19963 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "DELETE /compute/v2.1/servers/1a852e3a-0d2b-470a-a429-b4bac6aa8e6b" status: 404 len: 111 microversion: 2.1 time: 0.032642 May 26 12:53:35.193252 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 368/744] 10.222.0.41 () {58 vars in 1238 bytes} [Thu May 26 12:53:35 2022] DELETE /compute/v2.1/servers/1a852e3a-0d2b-470a-a429-b4bac6aa8e6b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 12:53:35.199091 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-faf2167a-751f-4e31-9341-e2b631334cd9 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:35.199697 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-faf2167a-751f-4e31-9341-e2b631334cd9 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] [instance: 1a852e3a-0d2b-470a-a429-b4bac6aa8e6b] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:35.205798 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-faf2167a-751f-4e31-9341-e2b631334cd9 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:35.206821 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-faf2167a-751f-4e31-9341-e2b631334cd9 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:35.207070 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-faf2167a-751f-4e31-9341-e2b631334cd9 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:35.207506 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-faf2167a-751f-4e31-9341-e2b631334cd9 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:35.222724 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.wsgi [None req-faf2167a-751f-4e31-9341-e2b631334cd9 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] HTTP exception thrown: Instance 1a852e3a-0d2b-470a-a429-b4bac6aa8e6b could not be found. May 26 12:53:35.225607 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-faf2167a-751f-4e31-9341-e2b631334cd9 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Request method failure captured: May 26 12:53:35.225607 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: request: GET /compute/v2.1/servers/1a852e3a-0d2b-470a-a429-b4bac6aa8e6b HTTP/1.1 May 26 12:53:35.225607 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Accept: application/json May 26 12:53:35.225607 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Accept-Encoding: identity May 26 12:53:35.225607 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Connection: close May 26 12:53:35.225607 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Content-Length: 0 May 26 12:53:35.225607 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Content-Type: application/json May 26 12:53:35.225607 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Host: 10.222.0.41 May 26 12:53:35.225607 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Openstack-System-Scope: None May 26 12:53:35.225607 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: User-Agent: python-urllib3/1.26.9 May 26 12:53:35.225607 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Auth-Token: gAAAAABij3aYTDT6d91IIen8MNgNrsA0ohBGn_dUC2tsponOFwNurwjlknBmFB36blSobobmDRibGa26en17LZfjuhgOSZiQsswJxea6OZWaEAKHfDkIbtu7XpKpGW-ZBZHCz2dZb9rYCBos_UyGkZJY7k8n757Ijkdz5EguRL9a0MDFor49yAU May 26 12:53:35.225607 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Domain-Id: None May 26 12:53:35.225607 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Domain-Name: None May 26 12:53:35.225607 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Identity-Status: Confirmed May 26 12:53:35.225607 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Is-Admin-Project: True May 26 12:53:35.225607 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Domain-Id: default May 26 12:53:35.225607 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Domain-Name: Default May 26 12:53:35.225607 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Id: cad768b45d17480d8d6bbbcff6032c8d May 26 12:53:35.225607 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Name: tempest-AttachVolumeNegativeTest-155076248 May 26 12:53:35.225607 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Role: member,reader May 26 12:53:35.225607 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Roles: member,reader May 26 12:53:35.227178 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/cad768b45d17480d8d6bbbcff6032c8d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/cad768b45d17480d8d6bbbcff6032c8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/cad768b45d17480d8d6bbbcff6032c8d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_cad768b45d17480d8d6bbbcff6032c8d", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 26 12:53:35.227178 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Tenant: tempest-AttachVolumeNegativeTest-155076248 May 26 12:53:35.227178 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Tenant-Id: cad768b45d17480d8d6bbbcff6032c8d May 26 12:53:35.227178 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-155076248 May 26 12:53:35.227178 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User: tempest-AttachVolumeNegativeTest-155076248-project May 26 12:53:35.227178 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Domain-Id: default May 26 12:53:35.227178 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Domain-Name: Default May 26 12:53:35.227178 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Id: 0537911b91184fcdbdcc9e93ec3fe5b9 May 26 12:53:35.227178 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Name: tempest-AttachVolumeNegativeTest-155076248-project May 26 12:53:35.227178 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: method: > May 26 12:53:35.227178 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: exception: Instance 1a852e3a-0d2b-470a-a429-b4bac6aa8e6b could not be found. May 26 12:53:35.227178 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: action_args: {'id': '1a852e3a-0d2b-470a-a429-b4bac6aa8e6b'} May 26 12:53:35.227898 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:53:35.227898 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:53:35.227898 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:53:35.227898 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:53:35.227898 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:53:35.227898 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:53:35.227898 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:53:35.227898 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:53:35.227898 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:53:35.227898 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:53:35.227898 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a852e3a-0d2b-470a-a429-b4bac6aa8e6b could not be found. May 26 12:53:35.227898 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:53:35.227898 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:53:35.227898 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:53:35.227898 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:53:35.227898 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:53:35.227898 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:53:35.227898 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:53:35.227898 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:53:35.227898 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:53:35.229022 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:53:35.229022 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 12:53:35.229022 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 12:53:35.229022 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:53:35.229022 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:53:35.229022 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:53:35.229022 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:53:35.229022 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a852e3a-0d2b-470a-a429-b4bac6aa8e6b could not be found. May 26 12:53:35.229022 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:53:35.229022 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:53:35.229022 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:53:35.229022 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:53:35.229022 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:53:35.229022 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:53:35.229022 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:53:35.229022 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:53:35.229022 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a852e3a-0d2b-470a-a429-b4bac6aa8e6b could not be found. May 26 12:53:35.229022 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:53:35.231599 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-faf2167a-751f-4e31-9341-e2b631334cd9 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] Returning 404 to user: Instance 1a852e3a-0d2b-470a-a429-b4bac6aa8e6b could not be found. {{(pid=124824) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:53:35.231599 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-faf2167a-751f-4e31-9341-e2b631334cd9 tempest-AttachVolumeNegativeTest-155076248 tempest-AttachVolumeNegativeTest-155076248-project] 10.222.0.41 "GET /compute/v2.1/servers/1a852e3a-0d2b-470a-a429-b4bac6aa8e6b" status: 404 len: 111 microversion: 2.1 time: 0.030444 May 26 12:53:35.231599 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 369/745] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:53:35 2022] GET /compute/v2.1/servers/1a852e3a-0d2b-470a-a429-b4bac6aa8e6b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 12:53:35.244193 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.network.neutron [None req-d3cb8fa7-b9f7-43c9-aad9-311c9cc5fca8 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] validate_networks() for [('e0b5fd96-31c5-48b3-8169-c7d54d8a5fc3', None, None, None, None, None)] {{(pid=124823) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 12:53:35.587786 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-94709460-c8dd-4a19-a766-704c73eac1d6 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:35.589128 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-94709460-c8dd-4a19-a766-704c73eac1d6 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 73592c9c-6dae-4521-a03d-e02749530cac] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:35.600705 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-94709460-c8dd-4a19-a766-704c73eac1d6 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:35.600705 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-94709460-c8dd-4a19-a766-704c73eac1d6 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:35.601204 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-94709460-c8dd-4a19-a766-704c73eac1d6 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:35.601957 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-94709460-c8dd-4a19-a766-704c73eac1d6 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:35.621102 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.wsgi [None req-94709460-c8dd-4a19-a766-704c73eac1d6 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] HTTP exception thrown: Instance 73592c9c-6dae-4521-a03d-e02749530cac could not be found. May 26 12:53:35.622747 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-94709460-c8dd-4a19-a766-704c73eac1d6 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Request method failure captured: May 26 12:53:35.622747 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: request: GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac HTTP/1.1 May 26 12:53:35.622747 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Accept: application/json May 26 12:53:35.622747 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Accept-Encoding: identity May 26 12:53:35.622747 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Connection: close May 26 12:53:35.622747 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Content-Length: 0 May 26 12:53:35.622747 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Content-Type: application/json May 26 12:53:35.622747 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Host: 10.222.0.41 May 26 12:53:35.622747 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Openstack-System-Scope: None May 26 12:53:35.622747 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: User-Agent: python-urllib3/1.26.9 May 26 12:53:35.622747 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Auth-Token: gAAAAABij3abBk4ixrYEcFZRskYSxhBr1BCkYClQrGuO_Zlfka9R9-e6ixZLTtGe1W200ciU4afgT-iKNG2YLJ1qONbypQIEnsgLaiYYPe6pwbyXejvkUDELr69D4q55WjpJbcWJ9gyFD_X0vSqw695wlbN0CreDwdaxxmAax9eJyLpupDKc0iE May 26 12:53:35.622747 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Domain-Id: None May 26 12:53:35.622747 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Domain-Name: None May 26 12:53:35.622747 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Identity-Status: Confirmed May 26 12:53:35.622747 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Is-Admin-Project: True May 26 12:53:35.622747 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Openstack-Nova-Api-Version: 2.20 May 26 12:53:35.622747 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Domain-Id: default May 26 12:53:35.622747 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Domain-Name: Default May 26 12:53:35.622747 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Id: a90e7edce8984d49b7bdebed2947b436 May 26 12:53:35.622747 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1557983772 May 26 12:53:35.622747 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Role: member,reader May 26 12:53:35.622747 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Roles: member,reader May 26 12:53:35.624118 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/a90e7edce8984d49b7bdebed2947b436"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/a90e7edce8984d49b7bdebed2947b436"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/a90e7edce8984d49b7bdebed2947b436"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_a90e7edce8984d49b7bdebed2947b436", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 26 12:53:35.624118 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1557983772 May 26 12:53:35.624118 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Tenant-Id: a90e7edce8984d49b7bdebed2947b436 May 26 12:53:35.624118 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1557983772 May 26 12:53:35.624118 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User: tempest-AttachVolumeShelveTestJSON-1557983772-project May 26 12:53:35.624118 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Domain-Id: default May 26 12:53:35.624118 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Domain-Name: Default May 26 12:53:35.624118 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Id: 1e83db01f0b24204a61b037b3c1f044c May 26 12:53:35.624118 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1557983772-project May 26 12:53:35.624118 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: method: > May 26 12:53:35.624118 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: exception: Instance 73592c9c-6dae-4521-a03d-e02749530cac could not be found. May 26 12:53:35.624118 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: action_args: {'id': '73592c9c-6dae-4521-a03d-e02749530cac'} May 26 12:53:35.624849 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:53:35.624849 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:53:35.624849 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:53:35.624849 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:53:35.624849 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:53:35.624849 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:53:35.624849 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:53:35.624849 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:53:35.624849 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:53:35.624849 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:53:35.624849 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73592c9c-6dae-4521-a03d-e02749530cac could not be found. May 26 12:53:35.624849 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:53:35.624849 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:53:35.624849 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:53:35.624849 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:53:35.624849 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:53:35.624849 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:53:35.624849 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:53:35.624849 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:53:35.624849 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:53:35.629167 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:53:35.629167 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 12:53:35.629167 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 12:53:35.629167 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:53:35.629167 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:53:35.629167 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:53:35.629167 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:53:35.629167 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73592c9c-6dae-4521-a03d-e02749530cac could not be found. May 26 12:53:35.629167 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:53:35.629167 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:53:35.629167 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:53:35.629167 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:53:35.629167 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:53:35.629167 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:53:35.629167 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:53:35.629167 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:53:35.629167 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73592c9c-6dae-4521-a03d-e02749530cac could not be found. May 26 12:53:35.629167 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:53:35.630324 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-94709460-c8dd-4a19-a766-704c73eac1d6 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Returning 404 to user: Instance 73592c9c-6dae-4521-a03d-e02749530cac could not be found. {{(pid=124824) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:53:35.630324 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-94709460-c8dd-4a19-a766-704c73eac1d6 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac" status: 404 len: 111 microversion: 2.20 time: 0.041306 May 26 12:53:35.630324 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 370/746] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:53:35 2022] GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 26 12:53:35.634950 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-1d8560c9-f9ee-4cbd-a5c0-9ef06821af62 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '.version_select at 0x7f26a1d798b0>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:35.712057 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-1d8560c9-f9ee-4cbd-a5c0-9ef06821af62 tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2064790035" status: 204 len: 0 microversion: 2.20 time: 0.081285 May 26 12:53:35.712578 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 371/747] 10.222.0.41 () {60 vars in 1261 bytes} [Thu May 26 12:53:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2064790035 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 26 12:53:35.944296 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.virt.hardware [None req-d3cb8fa7-b9f7-43c9-aad9-311c9cc5fca8 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Flavor limits 0:0:0 {{(pid=124823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 12:53:35.944721 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.virt.hardware [None req-d3cb8fa7-b9f7-43c9-aad9-311c9cc5fca8 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Image limits 0:0:0 {{(pid=124823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 12:53:35.945192 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.virt.hardware [None req-d3cb8fa7-b9f7-43c9-aad9-311c9cc5fca8 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Flavor pref 0:0:0 {{(pid=124823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 12:53:35.945648 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.virt.hardware [None req-d3cb8fa7-b9f7-43c9-aad9-311c9cc5fca8 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Image pref 0:0:0 {{(pid=124823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 12:53:35.946087 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.virt.hardware [None req-d3cb8fa7-b9f7-43c9-aad9-311c9cc5fca8 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 12:53:35.956078 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-d3cb8fa7-b9f7-43c9-aad9-311c9cc5fca8 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:35.956517 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-d3cb8fa7-b9f7-43c9-aad9-311c9cc5fca8 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:35.957303 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-d3cb8fa7-b9f7-43c9-aad9-311c9cc5fca8 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:35.957757 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-d3cb8fa7-b9f7-43c9-aad9-311c9cc5fca8 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:35.975384 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.quota [None req-d3cb8fa7-b9f7-43c9-aad9-311c9cc5fca8 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Getting quotas for project c876091609fe45ba80370a16748cbeb2. Resources: {'instances', 'ram', 'cores'} {{(pid=124823) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:53:35.979330 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.quota [None req-d3cb8fa7-b9f7-43c9-aad9-311c9cc5fca8 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Getting quotas for user 7277aedb35df448e8b3056f8bc395e32 and project c876091609fe45ba80370a16748cbeb2. Resources: {'instances', 'ram', 'cores'} {{(pid=124823) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:53:35.990229 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-d3cb8fa7-b9f7-43c9-aad9-311c9cc5fca8 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Going to run 1 instances... {{(pid=124823) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 12:53:35.992555 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-d3cb8fa7-b9f7-43c9-aad9-311c9cc5fca8 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] [instance: d1efb756-8e30-4c05-9156-de4ae119ac3c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='da4a92db-ecbf-4c08-83c9-50eebe42a9bb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124823) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 12:53:36.087507 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-d3cb8fa7-b9f7-43c9-aad9-311c9cc5fca8 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.906062 May 26 12:53:36.088286 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 377/748] 10.222.0.41 () {60 vars in 1146 bytes} [Thu May 26 12:53:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 907 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 26 12:53:36.098557 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-909d3568-f163-42a6-8c73-4507585dbbd4 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:36.099299 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-909d3568-f163-42a6-8c73-4507585dbbd4 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] [instance: d1efb756-8e30-4c05-9156-de4ae119ac3c] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:36.210667 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-909d3568-f163-42a6-8c73-4507585dbbd4 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7277aedb35df448e8b3056f8bc395e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c876091609fe45ba80370a16748cbeb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:36.218887 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-909d3568-f163-42a6-8c73-4507585dbbd4 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] 10.222.0.41 "GET /compute/v2.1/servers/d1efb756-8e30-4c05-9156-de4ae119ac3c" status: 200 len: 1259 microversion: 2.1 time: 0.124540 May 26 12:53:36.220299 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 372/749] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:53:36 2022] GET /compute/v2.1/servers/d1efb756-8e30-4c05-9156-de4ae119ac3c => generated 1259 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:53:37.237297 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-13acadd2-0715-4b23-9fb9-d3d656f1e4c0 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:37.238129 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-13acadd2-0715-4b23-9fb9-d3d656f1e4c0 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] [instance: d1efb756-8e30-4c05-9156-de4ae119ac3c] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:37.306445 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-13acadd2-0715-4b23-9fb9-d3d656f1e4c0 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7277aedb35df448e8b3056f8bc395e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c876091609fe45ba80370a16748cbeb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:37.313480 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-13acadd2-0715-4b23-9fb9-d3d656f1e4c0 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] 10.222.0.41 "GET /compute/v2.1/servers/d1efb756-8e30-4c05-9156-de4ae119ac3c" status: 200 len: 1259 microversion: 2.1 time: 0.080578 May 26 12:53:37.314152 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 378/750] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:53:37 2022] GET /compute/v2.1/servers/d1efb756-8e30-4c05-9156-de4ae119ac3c => generated 1259 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:53:38.073078 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-7b8e0e8f-7af0-472e-8cd2-5eddb7f583ea tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:38.073624 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-7b8e0e8f-7af0-472e-8cd2-5eddb7f583ea tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 73592c9c-6dae-4521-a03d-e02749530cac] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:38.080282 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-7b8e0e8f-7af0-472e-8cd2-5eddb7f583ea tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:38.081114 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-7b8e0e8f-7af0-472e-8cd2-5eddb7f583ea tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:38.081479 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-7b8e0e8f-7af0-472e-8cd2-5eddb7f583ea tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:38.081943 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-7b8e0e8f-7af0-472e-8cd2-5eddb7f583ea tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:38.096087 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.wsgi [None req-7b8e0e8f-7af0-472e-8cd2-5eddb7f583ea tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] HTTP exception thrown: Instance 73592c9c-6dae-4521-a03d-e02749530cac could not be found. May 26 12:53:38.097584 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-7b8e0e8f-7af0-472e-8cd2-5eddb7f583ea tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Request method failure captured: May 26 12:53:38.097584 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: request: DELETE /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac HTTP/1.1 May 26 12:53:38.097584 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Accept: application/json May 26 12:53:38.097584 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Accept-Encoding: identity May 26 12:53:38.097584 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Connection: close May 26 12:53:38.097584 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Content-Length: 0 May 26 12:53:38.097584 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Content-Type: application/json May 26 12:53:38.097584 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Host: 10.222.0.41 May 26 12:53:38.097584 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Openstack-System-Scope: None May 26 12:53:38.097584 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: User-Agent: python-urllib3/1.26.9 May 26 12:53:38.097584 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Auth-Token: gAAAAABij3abBk4ixrYEcFZRskYSxhBr1BCkYClQrGuO_Zlfka9R9-e6ixZLTtGe1W200ciU4afgT-iKNG2YLJ1qONbypQIEnsgLaiYYPe6pwbyXejvkUDELr69D4q55WjpJbcWJ9gyFD_X0vSqw695wlbN0CreDwdaxxmAax9eJyLpupDKc0iE May 26 12:53:38.097584 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Domain-Id: None May 26 12:53:38.097584 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Domain-Name: None May 26 12:53:38.097584 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Identity-Status: Confirmed May 26 12:53:38.097584 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Is-Admin-Project: True May 26 12:53:38.097584 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Openstack-Nova-Api-Version: 2.20 May 26 12:53:38.097584 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Domain-Id: default May 26 12:53:38.097584 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Domain-Name: Default May 26 12:53:38.097584 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Id: a90e7edce8984d49b7bdebed2947b436 May 26 12:53:38.097584 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1557983772 May 26 12:53:38.097584 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Role: member,reader May 26 12:53:38.097584 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Roles: member,reader May 26 12:53:38.099198 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/a90e7edce8984d49b7bdebed2947b436"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/a90e7edce8984d49b7bdebed2947b436"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/a90e7edce8984d49b7bdebed2947b436"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_a90e7edce8984d49b7bdebed2947b436", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 26 12:53:38.099198 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1557983772 May 26 12:53:38.099198 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Tenant-Id: a90e7edce8984d49b7bdebed2947b436 May 26 12:53:38.099198 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1557983772 May 26 12:53:38.099198 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User: tempest-AttachVolumeShelveTestJSON-1557983772-project May 26 12:53:38.099198 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Domain-Id: default May 26 12:53:38.099198 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Domain-Name: Default May 26 12:53:38.099198 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Id: 1e83db01f0b24204a61b037b3c1f044c May 26 12:53:38.099198 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1557983772-project May 26 12:53:38.099198 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: method: > May 26 12:53:38.099198 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: exception: Instance 73592c9c-6dae-4521-a03d-e02749530cac could not be found. May 26 12:53:38.099198 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: action_args: {'id': '73592c9c-6dae-4521-a03d-e02749530cac'} May 26 12:53:38.100234 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:53:38.100234 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:53:38.100234 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:53:38.100234 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:53:38.100234 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:53:38.100234 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:53:38.100234 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:53:38.100234 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:53:38.100234 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:53:38.100234 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:53:38.100234 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73592c9c-6dae-4521-a03d-e02749530cac could not be found. May 26 12:53:38.100234 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:53:38.100234 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:53:38.100234 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:53:38.100234 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:53:38.100234 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:53:38.100234 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:53:38.100234 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:53:38.100234 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:53:38.100234 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:53:38.101759 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:53:38.101759 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 12:53:38.101759 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 12:53:38.101759 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 12:53:38.101759 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 12:53:38.101759 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:53:38.101759 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:53:38.101759 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:53:38.101759 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:53:38.101759 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73592c9c-6dae-4521-a03d-e02749530cac could not be found. May 26 12:53:38.101759 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:53:38.101759 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:53:38.101759 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:53:38.101759 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:53:38.101759 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:53:38.101759 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:53:38.101759 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:53:38.101759 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:53:38.101759 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73592c9c-6dae-4521-a03d-e02749530cac could not be found. May 26 12:53:38.101759 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:53:38.103296 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-7b8e0e8f-7af0-472e-8cd2-5eddb7f583ea tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Returning 404 to user: Instance 73592c9c-6dae-4521-a03d-e02749530cac could not be found. {{(pid=124824) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:53:38.103296 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-7b8e0e8f-7af0-472e-8cd2-5eddb7f583ea tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "DELETE /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac" status: 404 len: 111 microversion: 2.20 time: 0.030071 May 26 12:53:38.103296 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 373/751] 10.222.0.41 () {60 vars in 1279 bytes} [Thu May 26 12:53:38 2022] DELETE /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 26 12:53:38.108466 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-05269f6f-53a6-4a1e-bd38-7d29fd88c46c tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:38.109043 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-05269f6f-53a6-4a1e-bd38-7d29fd88c46c tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 73592c9c-6dae-4521-a03d-e02749530cac] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:38.115609 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-05269f6f-53a6-4a1e-bd38-7d29fd88c46c tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:38.116152 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-05269f6f-53a6-4a1e-bd38-7d29fd88c46c tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:38.116917 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-05269f6f-53a6-4a1e-bd38-7d29fd88c46c tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:38.117349 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-05269f6f-53a6-4a1e-bd38-7d29fd88c46c tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:38.133179 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.wsgi [None req-05269f6f-53a6-4a1e-bd38-7d29fd88c46c tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] HTTP exception thrown: Instance 73592c9c-6dae-4521-a03d-e02749530cac could not be found. May 26 12:53:38.134877 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-05269f6f-53a6-4a1e-bd38-7d29fd88c46c tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Request method failure captured: May 26 12:53:38.134877 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: request: GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac HTTP/1.1 May 26 12:53:38.134877 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Accept: application/json May 26 12:53:38.134877 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Accept-Encoding: identity May 26 12:53:38.134877 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Connection: close May 26 12:53:38.134877 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Content-Length: 0 May 26 12:53:38.134877 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Content-Type: application/json May 26 12:53:38.134877 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Host: 10.222.0.41 May 26 12:53:38.134877 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Openstack-System-Scope: None May 26 12:53:38.134877 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: User-Agent: python-urllib3/1.26.9 May 26 12:53:38.134877 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Auth-Token: gAAAAABij3abBk4ixrYEcFZRskYSxhBr1BCkYClQrGuO_Zlfka9R9-e6ixZLTtGe1W200ciU4afgT-iKNG2YLJ1qONbypQIEnsgLaiYYPe6pwbyXejvkUDELr69D4q55WjpJbcWJ9gyFD_X0vSqw695wlbN0CreDwdaxxmAax9eJyLpupDKc0iE May 26 12:53:38.134877 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Domain-Id: None May 26 12:53:38.134877 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Domain-Name: None May 26 12:53:38.134877 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Identity-Status: Confirmed May 26 12:53:38.134877 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Is-Admin-Project: True May 26 12:53:38.134877 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Openstack-Nova-Api-Version: 2.20 May 26 12:53:38.134877 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Project-Domain-Id: default May 26 12:53:38.134877 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Project-Domain-Name: Default May 26 12:53:38.134877 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Project-Id: a90e7edce8984d49b7bdebed2947b436 May 26 12:53:38.134877 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1557983772 May 26 12:53:38.134877 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Role: member,reader May 26 12:53:38.134877 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Roles: member,reader May 26 12:53:38.136608 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/a90e7edce8984d49b7bdebed2947b436"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/a90e7edce8984d49b7bdebed2947b436"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/a90e7edce8984d49b7bdebed2947b436"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_a90e7edce8984d49b7bdebed2947b436", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 26 12:53:38.136608 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1557983772 May 26 12:53:38.136608 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Tenant-Id: a90e7edce8984d49b7bdebed2947b436 May 26 12:53:38.136608 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1557983772 May 26 12:53:38.136608 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User: tempest-AttachVolumeShelveTestJSON-1557983772-project May 26 12:53:38.136608 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User-Domain-Id: default May 26 12:53:38.136608 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User-Domain-Name: Default May 26 12:53:38.136608 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User-Id: 1e83db01f0b24204a61b037b3c1f044c May 26 12:53:38.136608 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1557983772-project May 26 12:53:38.136608 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: method: > May 26 12:53:38.136608 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: exception: Instance 73592c9c-6dae-4521-a03d-e02749530cac could not be found. May 26 12:53:38.136608 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: action_args: {'id': '73592c9c-6dae-4521-a03d-e02749530cac'} May 26 12:53:38.138409 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:53:38.138409 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:53:38.138409 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:53:38.138409 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:53:38.138409 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:53:38.138409 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:53:38.138409 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:53:38.138409 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:53:38.138409 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:53:38.138409 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:53:38.138409 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73592c9c-6dae-4521-a03d-e02749530cac could not be found. May 26 12:53:38.138409 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:53:38.138409 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:53:38.138409 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:53:38.138409 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:53:38.138409 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:53:38.138409 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:53:38.138409 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:53:38.138409 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:53:38.138409 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:53:38.139662 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:53:38.139662 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 12:53:38.139662 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 12:53:38.139662 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:53:38.139662 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:53:38.139662 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:53:38.139662 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:53:38.139662 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73592c9c-6dae-4521-a03d-e02749530cac could not be found. May 26 12:53:38.139662 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:53:38.139662 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:53:38.139662 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:53:38.139662 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:53:38.139662 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:53:38.139662 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:53:38.139662 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:53:38.139662 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:53:38.139662 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73592c9c-6dae-4521-a03d-e02749530cac could not be found. May 26 12:53:38.139662 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:53:38.141652 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-05269f6f-53a6-4a1e-bd38-7d29fd88c46c tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Returning 404 to user: Instance 73592c9c-6dae-4521-a03d-e02749530cac could not be found. {{(pid=124823) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:53:38.141652 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-05269f6f-53a6-4a1e-bd38-7d29fd88c46c tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac" status: 404 len: 111 microversion: 2.20 time: 0.032442 May 26 12:53:38.141652 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 379/752] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:53:38 2022] GET /compute/v2.1/servers/73592c9c-6dae-4521-a03d-e02749530cac => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 26 12:53:38.330345 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-e367c300-423a-4b68-8835-62e2d4317511 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:38.330880 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-e367c300-423a-4b68-8835-62e2d4317511 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] [instance: d1efb756-8e30-4c05-9156-de4ae119ac3c] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:38.336949 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-e367c300-423a-4b68-8835-62e2d4317511 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:38.337416 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-e367c300-423a-4b68-8835-62e2d4317511 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:38.338317 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-e367c300-423a-4b68-8835-62e2d4317511 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:38.338731 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-e367c300-423a-4b68-8835-62e2d4317511 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:38.454284 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-e367c300-423a-4b68-8835-62e2d4317511 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7277aedb35df448e8b3056f8bc395e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c876091609fe45ba80370a16748cbeb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:38.461260 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG dbcounter [-] [124824] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:53:38.466656 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-e367c300-423a-4b68-8835-62e2d4317511 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] 10.222.0.41 "GET /compute/v2.1/servers/d1efb756-8e30-4c05-9156-de4ae119ac3c" status: 200 len: 1311 microversion: 2.1 time: 0.140118 May 26 12:53:38.467969 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 374/753] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:53:38 2022] GET /compute/v2.1/servers/d1efb756-8e30-4c05-9156-de4ae119ac3c => generated 1311 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:53:39.486136 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-9b20050f-250e-45aa-9659-c1b2ee3c3c7e tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:39.487457 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-9b20050f-250e-45aa-9659-c1b2ee3c3c7e tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 7ffbf048-2aa0-4656-a6cd-923b35031eaa] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:39.488213 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-21464862-eee7-479f-bb69-1f075ec55627 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:39.488987 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-21464862-eee7-479f-bb69-1f075ec55627 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] [instance: d1efb756-8e30-4c05-9156-de4ae119ac3c] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:39.495590 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-9b20050f-250e-45aa-9659-c1b2ee3c3c7e tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:39.496325 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-9b20050f-250e-45aa-9659-c1b2ee3c3c7e tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:39.497369 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-9b20050f-250e-45aa-9659-c1b2ee3c3c7e tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:39.498055 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-9b20050f-250e-45aa-9659-c1b2ee3c3c7e tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:39.500165 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-21464862-eee7-479f-bb69-1f075ec55627 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:39.500978 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-21464862-eee7-479f-bb69-1f075ec55627 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:39.502260 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-21464862-eee7-479f-bb69-1f075ec55627 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:39.502918 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-21464862-eee7-479f-bb69-1f075ec55627 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:39.514092 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.wsgi [None req-9b20050f-250e-45aa-9659-c1b2ee3c3c7e tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] HTTP exception thrown: Instance 7ffbf048-2aa0-4656-a6cd-923b35031eaa could not be found. May 26 12:53:39.516060 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-9b20050f-250e-45aa-9659-c1b2ee3c3c7e tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Request method failure captured: May 26 12:53:39.516060 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: request: DELETE /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa HTTP/1.1 May 26 12:53:39.516060 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Accept: application/json May 26 12:53:39.516060 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Accept-Encoding: identity May 26 12:53:39.516060 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Connection: close May 26 12:53:39.516060 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Content-Length: 0 May 26 12:53:39.516060 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Content-Type: application/json May 26 12:53:39.516060 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Host: 10.222.0.41 May 26 12:53:39.516060 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Openstack-System-Scope: None May 26 12:53:39.516060 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: User-Agent: python-urllib3/1.26.9 May 26 12:53:39.516060 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Auth-Token: gAAAAABij3abBk4ixrYEcFZRskYSxhBr1BCkYClQrGuO_Zlfka9R9-e6ixZLTtGe1W200ciU4afgT-iKNG2YLJ1qONbypQIEnsgLaiYYPe6pwbyXejvkUDELr69D4q55WjpJbcWJ9gyFD_X0vSqw695wlbN0CreDwdaxxmAax9eJyLpupDKc0iE May 26 12:53:39.516060 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Domain-Id: None May 26 12:53:39.516060 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Domain-Name: None May 26 12:53:39.516060 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Identity-Status: Confirmed May 26 12:53:39.516060 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Is-Admin-Project: True May 26 12:53:39.516060 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Openstack-Nova-Api-Version: 2.20 May 26 12:53:39.516060 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Project-Domain-Id: default May 26 12:53:39.516060 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Project-Domain-Name: Default May 26 12:53:39.516060 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Project-Id: a90e7edce8984d49b7bdebed2947b436 May 26 12:53:39.516060 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1557983772 May 26 12:53:39.516060 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Role: member,reader May 26 12:53:39.516060 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Roles: member,reader May 26 12:53:39.518688 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/a90e7edce8984d49b7bdebed2947b436"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/a90e7edce8984d49b7bdebed2947b436"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/a90e7edce8984d49b7bdebed2947b436"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_a90e7edce8984d49b7bdebed2947b436", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 26 12:53:39.518688 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1557983772 May 26 12:53:39.518688 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Tenant-Id: a90e7edce8984d49b7bdebed2947b436 May 26 12:53:39.518688 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1557983772 May 26 12:53:39.518688 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User: tempest-AttachVolumeShelveTestJSON-1557983772-project May 26 12:53:39.518688 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User-Domain-Id: default May 26 12:53:39.518688 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User-Domain-Name: Default May 26 12:53:39.518688 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User-Id: 1e83db01f0b24204a61b037b3c1f044c May 26 12:53:39.518688 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1557983772-project May 26 12:53:39.518688 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: method: > May 26 12:53:39.518688 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: exception: Instance 7ffbf048-2aa0-4656-a6cd-923b35031eaa could not be found. May 26 12:53:39.518688 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: action_args: {'id': '7ffbf048-2aa0-4656-a6cd-923b35031eaa'} May 26 12:53:39.520075 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:53:39.520075 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:53:39.520075 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:53:39.520075 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:53:39.520075 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:53:39.520075 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:53:39.520075 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:53:39.520075 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:53:39.520075 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:53:39.520075 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:53:39.520075 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ffbf048-2aa0-4656-a6cd-923b35031eaa could not be found. May 26 12:53:39.520075 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:53:39.520075 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:53:39.520075 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:53:39.520075 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:53:39.520075 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:53:39.520075 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:53:39.520075 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:53:39.520075 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:53:39.520075 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:53:39.526815 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:53:39.526815 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 12:53:39.526815 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 12:53:39.526815 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 12:53:39.526815 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 12:53:39.526815 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:53:39.526815 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:53:39.526815 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:53:39.526815 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:53:39.526815 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ffbf048-2aa0-4656-a6cd-923b35031eaa could not be found. May 26 12:53:39.526815 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:53:39.526815 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:53:39.526815 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:53:39.526815 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:53:39.526815 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:53:39.526815 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:53:39.526815 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:53:39.526815 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:53:39.526815 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ffbf048-2aa0-4656-a6cd-923b35031eaa could not be found. May 26 12:53:39.526815 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:53:39.529615 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-9b20050f-250e-45aa-9659-c1b2ee3c3c7e tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Returning 404 to user: Instance 7ffbf048-2aa0-4656-a6cd-923b35031eaa could not be found. {{(pid=124823) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:53:39.529615 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-9b20050f-250e-45aa-9659-c1b2ee3c3c7e tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "DELETE /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa" status: 404 len: 111 microversion: 2.20 time: 0.035986 May 26 12:53:39.529615 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 380/754] 10.222.0.41 () {60 vars in 1279 bytes} [Thu May 26 12:53:39 2022] DELETE /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 26 12:53:39.537903 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-31958507-fea1-40ab-a56c-bf03f48cb29e tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:39.538805 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-31958507-fea1-40ab-a56c-bf03f48cb29e tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] [instance: 7ffbf048-2aa0-4656-a6cd-923b35031eaa] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:39.556280 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-31958507-fea1-40ab-a56c-bf03f48cb29e tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:39.556742 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-31958507-fea1-40ab-a56c-bf03f48cb29e tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:39.560716 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-31958507-fea1-40ab-a56c-bf03f48cb29e tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:39.560716 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-31958507-fea1-40ab-a56c-bf03f48cb29e tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:39.573530 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.wsgi [None req-31958507-fea1-40ab-a56c-bf03f48cb29e tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] HTTP exception thrown: Instance 7ffbf048-2aa0-4656-a6cd-923b35031eaa could not be found. May 26 12:53:39.575104 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-31958507-fea1-40ab-a56c-bf03f48cb29e tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Request method failure captured: May 26 12:53:39.575104 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: request: GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa HTTP/1.1 May 26 12:53:39.575104 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Accept: application/json May 26 12:53:39.575104 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Accept-Encoding: identity May 26 12:53:39.575104 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Connection: close May 26 12:53:39.575104 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Content-Length: 0 May 26 12:53:39.575104 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Content-Type: application/json May 26 12:53:39.575104 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Host: 10.222.0.41 May 26 12:53:39.575104 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Openstack-System-Scope: None May 26 12:53:39.575104 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: User-Agent: python-urllib3/1.26.9 May 26 12:53:39.575104 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Auth-Token: gAAAAABij3abBk4ixrYEcFZRskYSxhBr1BCkYClQrGuO_Zlfka9R9-e6ixZLTtGe1W200ciU4afgT-iKNG2YLJ1qONbypQIEnsgLaiYYPe6pwbyXejvkUDELr69D4q55WjpJbcWJ9gyFD_X0vSqw695wlbN0CreDwdaxxmAax9eJyLpupDKc0iE May 26 12:53:39.575104 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Domain-Id: None May 26 12:53:39.575104 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Domain-Name: None May 26 12:53:39.575104 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Identity-Status: Confirmed May 26 12:53:39.575104 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Is-Admin-Project: True May 26 12:53:39.575104 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Openstack-Nova-Api-Version: 2.20 May 26 12:53:39.575104 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Project-Domain-Id: default May 26 12:53:39.575104 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Project-Domain-Name: Default May 26 12:53:39.575104 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Project-Id: a90e7edce8984d49b7bdebed2947b436 May 26 12:53:39.575104 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1557983772 May 26 12:53:39.575104 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Role: member,reader May 26 12:53:39.575104 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Roles: member,reader May 26 12:53:39.576842 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/a90e7edce8984d49b7bdebed2947b436"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/a90e7edce8984d49b7bdebed2947b436"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/a90e7edce8984d49b7bdebed2947b436"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_a90e7edce8984d49b7bdebed2947b436", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 26 12:53:39.576842 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1557983772 May 26 12:53:39.576842 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Tenant-Id: a90e7edce8984d49b7bdebed2947b436 May 26 12:53:39.576842 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1557983772 May 26 12:53:39.576842 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User: tempest-AttachVolumeShelveTestJSON-1557983772-project May 26 12:53:39.576842 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User-Domain-Id: default May 26 12:53:39.576842 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User-Domain-Name: Default May 26 12:53:39.576842 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User-Id: 1e83db01f0b24204a61b037b3c1f044c May 26 12:53:39.576842 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1557983772-project May 26 12:53:39.576842 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: method: > May 26 12:53:39.576842 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: exception: Instance 7ffbf048-2aa0-4656-a6cd-923b35031eaa could not be found. May 26 12:53:39.576842 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: action_args: {'id': '7ffbf048-2aa0-4656-a6cd-923b35031eaa'} May 26 12:53:39.577786 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:53:39.577786 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:53:39.577786 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:53:39.577786 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:53:39.577786 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:53:39.577786 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:53:39.577786 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:53:39.577786 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:53:39.577786 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:53:39.577786 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:53:39.577786 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ffbf048-2aa0-4656-a6cd-923b35031eaa could not be found. May 26 12:53:39.577786 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:53:39.577786 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:53:39.577786 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:53:39.577786 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:53:39.577786 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:53:39.577786 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:53:39.577786 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:53:39.577786 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:53:39.577786 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:53:39.579564 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:53:39.579564 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 12:53:39.579564 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 12:53:39.579564 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:53:39.579564 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:53:39.579564 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:53:39.579564 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:53:39.579564 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ffbf048-2aa0-4656-a6cd-923b35031eaa could not be found. May 26 12:53:39.579564 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:53:39.579564 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:53:39.579564 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:53:39.579564 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:53:39.579564 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:53:39.579564 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:53:39.579564 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:53:39.579564 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:53:39.579564 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ffbf048-2aa0-4656-a6cd-923b35031eaa could not be found. May 26 12:53:39.579564 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:53:39.580972 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-31958507-fea1-40ab-a56c-bf03f48cb29e tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] Returning 404 to user: Instance 7ffbf048-2aa0-4656-a6cd-923b35031eaa could not be found. {{(pid=124823) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:53:39.580972 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-31958507-fea1-40ab-a56c-bf03f48cb29e tempest-AttachVolumeShelveTestJSON-1557983772 tempest-AttachVolumeShelveTestJSON-1557983772-project] 10.222.0.41 "GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa" status: 404 len: 111 microversion: 2.20 time: 0.053922 May 26 12:53:39.580972 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 381/755] 10.222.0.41 () {60 vars in 1276 bytes} [Thu May 26 12:53:39 2022] GET /compute/v2.1/servers/7ffbf048-2aa0-4656-a6cd-923b35031eaa => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 26 12:53:39.716092 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-21464862-eee7-479f-bb69-1f075ec55627 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7277aedb35df448e8b3056f8bc395e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c876091609fe45ba80370a16748cbeb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:39.725365 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-21464862-eee7-479f-bb69-1f075ec55627 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] 10.222.0.41 "GET /compute/v2.1/servers/d1efb756-8e30-4c05-9156-de4ae119ac3c" status: 200 len: 1317 microversion: 2.1 time: 0.242973 May 26 12:53:39.736095 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 375/756] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:53:39 2022] GET /compute/v2.1/servers/d1efb756-8e30-4c05-9156-de4ae119ac3c => generated 1317 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:53:40.745321 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-b65a8f61-9956-4b14-b511-fe60cc81a4c9 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:40.746981 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-b65a8f61-9956-4b14-b511-fe60cc81a4c9 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] [instance: d1efb756-8e30-4c05-9156-de4ae119ac3c] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:40.795847 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-b65a8f61-9956-4b14-b511-fe60cc81a4c9 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:40.796313 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-b65a8f61-9956-4b14-b511-fe60cc81a4c9 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:40.797124 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-b65a8f61-9956-4b14-b511-fe60cc81a4c9 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:40.797568 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-b65a8f61-9956-4b14-b511-fe60cc81a4c9 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:41.144364 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-b65a8f61-9956-4b14-b511-fe60cc81a4c9 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7277aedb35df448e8b3056f8bc395e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c876091609fe45ba80370a16748cbeb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:41.153658 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-b65a8f61-9956-4b14-b511-fe60cc81a4c9 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] 10.222.0.41 "GET /compute/v2.1/servers/d1efb756-8e30-4c05-9156-de4ae119ac3c" status: 200 len: 1359 microversion: 2.1 time: 0.413921 May 26 12:53:41.154613 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 382/757] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:53:40 2022] GET /compute/v2.1/servers/d1efb756-8e30-4c05-9156-de4ae119ac3c => generated 1359 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:53:42.121138 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [req-3857c7ea-bb9a-4ce7-8ff1-801e6cf28dbe req-a5d65661-bfd3-4520-a3f4-7b991a2f2681 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1efb756-8e30-4c05-9156-de4ae119ac3c", "tag": "114a1a6a-836f-4257-81d6-756de175e28e"}]} {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:53:42.146702 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [req-3857c7ea-bb9a-4ce7-8ff1-801e6cf28dbe req-a5d65661-bfd3-4520-a3f4-7b991a2f2681 service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:42.147636 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [req-3857c7ea-bb9a-4ce7-8ff1-801e6cf28dbe req-a5d65661-bfd3-4520-a3f4-7b991a2f2681 service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:42.172890 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-0f677ba3-1936-4a33-975b-06d1ff2b981c tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:42.173594 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-0f677ba3-1936-4a33-975b-06d1ff2b981c tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] [instance: d1efb756-8e30-4c05-9156-de4ae119ac3c] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:42.195088 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.compute.server_external_events [req-3857c7ea-bb9a-4ce7-8ff1-801e6cf28dbe req-a5d65661-bfd3-4520-a3f4-7b991a2f2681 service nova] Creating event network-changed:114a1a6a-836f-4257-81d6-756de175e28e for instance d1efb756-8e30-4c05-9156-de4ae119ac3c on hv-cinder-81571 May 26 12:53:42.201081 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [req-3857c7ea-bb9a-4ce7-8ff1-801e6cf28dbe req-a5d65661-bfd3-4520-a3f4-7b991a2f2681 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086085 May 26 12:53:42.202435 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 376/758] 10.222.0.41 () {64 vars in 1317 bytes} [Thu May 26 12:53:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:53:42.206354 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-0f677ba3-1936-4a33-975b-06d1ff2b981c tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:42.206897 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-0f677ba3-1936-4a33-975b-06d1ff2b981c tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:42.207736 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-0f677ba3-1936-4a33-975b-06d1ff2b981c tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:42.208280 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-0f677ba3-1936-4a33-975b-06d1ff2b981c tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:43.075996 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-0f677ba3-1936-4a33-975b-06d1ff2b981c tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7277aedb35df448e8b3056f8bc395e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c876091609fe45ba80370a16748cbeb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:43.095461 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-0f677ba3-1936-4a33-975b-06d1ff2b981c tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] 10.222.0.41 "GET /compute/v2.1/servers/d1efb756-8e30-4c05-9156-de4ae119ac3c" status: 200 len: 1359 microversion: 2.1 time: 0.926680 May 26 12:53:43.099743 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 383/759] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:53:42 2022] GET /compute/v2.1/servers/d1efb756-8e30-4c05-9156-de4ae119ac3c => generated 1359 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:53:43.906889 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-2e2e1eb5-85d3-44cd-80dd-e7c222cf70a6 tempest-VolumesNegativeTest-816160347 tempest-VolumesNegativeTest-816160347-project] Action: 'create', calling method: .version_select at 0x7f26a1d685e0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1655878718", "metadata": {"Type": "work"}}} {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:53:43.923879 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-2e2e1eb5-85d3-44cd-80dd-e7c222cf70a6 tempest-VolumesNegativeTest-816160347 tempest-VolumesNegativeTest-816160347-project] Request method failure captured: May 26 12:53:43.923879 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 26 12:53:43.923879 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Accept: application/json May 26 12:53:43.923879 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Accept-Encoding: identity May 26 12:53:43.923879 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Connection: close May 26 12:53:43.923879 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Content-Length: 122 May 26 12:53:43.923879 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Content-Type: application/json May 26 12:53:43.923879 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Host: 10.222.0.41 May 26 12:53:43.923879 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Openstack-System-Scope: None May 26 12:53:43.923879 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: User-Agent: python-urllib3/1.26.9 May 26 12:53:43.923879 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Auth-Token: gAAAAABij3hXMtiRzHEEQC3DxN_sg8eh1e1_4uHDN7nj178Y3L29nKzePP_r62xLbtVEuDzuvrxbB6rt-eJqN5QysTpcvl9-DykMDH5GfTnK-YZJX-1TfJIfI6wF-uca-ovglFRwnBe3xKQ9CkwMXLCvDXS5XpmuSJnhITR2x4GHOOsP24mCymY May 26 12:53:43.923879 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Domain-Id: None May 26 12:53:43.923879 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Domain-Name: None May 26 12:53:43.923879 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Identity-Status: Confirmed May 26 12:53:43.923879 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Is-Admin-Project: True May 26 12:53:43.923879 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Domain-Id: default May 26 12:53:43.923879 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Domain-Name: Default May 26 12:53:43.923879 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Id: 650fa64e79474bb0a55fc1ecbcf422ec May 26 12:53:43.923879 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Name: tempest-VolumesNegativeTest-816160347 May 26 12:53:43.923879 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Role: member,reader May 26 12:53:43.923879 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Roles: member,reader May 26 12:53:43.925311 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/650fa64e79474bb0a55fc1ecbcf422ec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/650fa64e79474bb0a55fc1ecbcf422ec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/650fa64e79474bb0a55fc1ecbcf422ec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_650fa64e79474bb0a55fc1ecbcf422ec", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 26 12:53:43.925311 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Tenant: tempest-VolumesNegativeTest-816160347 May 26 12:53:43.925311 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Tenant-Id: 650fa64e79474bb0a55fc1ecbcf422ec May 26 12:53:43.925311 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Tenant-Name: tempest-VolumesNegativeTest-816160347 May 26 12:53:43.925311 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User: tempest-VolumesNegativeTest-816160347-project May 26 12:53:43.925311 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Domain-Id: default May 26 12:53:43.925311 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Domain-Name: Default May 26 12:53:43.925311 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Id: d86d99b601ce4c67994d3dc5de21eab2 May 26 12:53:43.925311 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Name: tempest-VolumesNegativeTest-816160347-project May 26 12:53:43.925311 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: May 26 12:53:43.925311 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1655878718", "metadata": {"Type": "work"}}} May 26 12:53:43.925311 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: method: May 26 12:53:43.925311 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 26 12:53:43.926258 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1655878718', 'metadata': {'Type': 'work'}}}} May 26 12:53:43.926258 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:53:43.926258 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:53:43.926258 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 26 12:53:43.926258 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 26 12:53:43.926258 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 26 12:53:43.926258 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi raise error May 26 12:53:43.926258 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 26 12:53:43.926258 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:53:43.926258 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 26 12:53:43.926258 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 26 12:53:43.926258 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:53:43.926258 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi On instance['volume']: May 26 12:53:43.926258 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi '#$%' May 26 12:53:43.926258 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:53:43.926258 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:53:43.926258 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:53:43.926258 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:53:43.926258 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:53:43.926258 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:53:43.926258 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:53:43.926258 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:53:43.932488 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 12:53:43.932488 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 12:53:43.932488 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:53:43.932488 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:53:43.932488 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 26 12:53:43.932488 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 26 12:53:43.932488 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 26 12:53:43.932488 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 26 12:53:43.932488 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 26 12:53:43.932488 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 26 12:53:43.932488 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 26 12:53:43.932488 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:53:43.932488 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:53:43.932488 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:53:43.932488 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:53:43.932488 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:53:43.932488 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:53:43.932488 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 26 12:53:43.932488 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 26 12:53:43.935174 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 26 12:53:43.935174 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:53:43.935174 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-2e2e1eb5-85d3-44cd-80dd-e7c222cf70a6 tempest-VolumesNegativeTest-816160347 tempest-VolumesNegativeTest-816160347-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124824) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:53:43.935174 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-2e2e1eb5-85d3-44cd-80dd-e7c222cf70a6 tempest-VolumesNegativeTest-816160347 tempest-VolumesNegativeTest-816160347-project] 10.222.0.41 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.316264 May 26 12:53:43.935174 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 377/760] 10.222.0.41 () {60 vars in 1155 bytes} [Thu May 26 12:53:43 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 319 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 26 12:53:43.940128 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-244ba4ea-1de7-4a1e-a6b8-157523a9925e tempest-VolumesNegativeTest-816160347 tempest-VolumesNegativeTest-816160347-project] Action: 'create', calling method: .version_select at 0x7f26a1d04310>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1416122294", "metadata": {"Type": "work"}}} {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:53:43.944813 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-244ba4ea-1de7-4a1e-a6b8-157523a9925e tempest-VolumesNegativeTest-816160347 tempest-VolumesNegativeTest-816160347-project] Request method failure captured: May 26 12:53:43.944813 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 26 12:53:43.944813 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Accept: application/json May 26 12:53:43.944813 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Accept-Encoding: identity May 26 12:53:43.944813 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Connection: close May 26 12:53:43.944813 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Content-Length: 120 May 26 12:53:43.944813 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Content-Type: application/json May 26 12:53:43.944813 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Host: 10.222.0.41 May 26 12:53:43.944813 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Openstack-System-Scope: None May 26 12:53:43.944813 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: User-Agent: python-urllib3/1.26.9 May 26 12:53:43.944813 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Auth-Token: gAAAAABij3hXMtiRzHEEQC3DxN_sg8eh1e1_4uHDN7nj178Y3L29nKzePP_r62xLbtVEuDzuvrxbB6rt-eJqN5QysTpcvl9-DykMDH5GfTnK-YZJX-1TfJIfI6wF-uca-ovglFRwnBe3xKQ9CkwMXLCvDXS5XpmuSJnhITR2x4GHOOsP24mCymY May 26 12:53:43.944813 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Domain-Id: None May 26 12:53:43.944813 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Domain-Name: None May 26 12:53:43.944813 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Identity-Status: Confirmed May 26 12:53:43.944813 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Is-Admin-Project: True May 26 12:53:43.944813 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Project-Domain-Id: default May 26 12:53:43.944813 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Project-Domain-Name: Default May 26 12:53:43.944813 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Project-Id: 650fa64e79474bb0a55fc1ecbcf422ec May 26 12:53:43.944813 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Project-Name: tempest-VolumesNegativeTest-816160347 May 26 12:53:43.944813 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Role: member,reader May 26 12:53:43.944813 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Roles: member,reader May 26 12:53:43.946195 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/650fa64e79474bb0a55fc1ecbcf422ec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/650fa64e79474bb0a55fc1ecbcf422ec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/650fa64e79474bb0a55fc1ecbcf422ec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_650fa64e79474bb0a55fc1ecbcf422ec", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 26 12:53:43.946195 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Tenant: tempest-VolumesNegativeTest-816160347 May 26 12:53:43.946195 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Tenant-Id: 650fa64e79474bb0a55fc1ecbcf422ec May 26 12:53:43.946195 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Tenant-Name: tempest-VolumesNegativeTest-816160347 May 26 12:53:43.946195 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User: tempest-VolumesNegativeTest-816160347-project May 26 12:53:43.946195 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User-Domain-Id: default May 26 12:53:43.946195 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User-Domain-Name: Default May 26 12:53:43.946195 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User-Id: d86d99b601ce4c67994d3dc5de21eab2 May 26 12:53:43.946195 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User-Name: tempest-VolumesNegativeTest-816160347-project May 26 12:53:43.946195 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: May 26 12:53:43.946195 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1416122294", "metadata": {"Type": "work"}}} May 26 12:53:43.946195 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: method: May 26 12:53:43.946195 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 26 12:53:43.947010 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1416122294', 'metadata': {'Type': 'work'}}}} May 26 12:53:43.947010 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:53:43.947010 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:53:43.947010 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 26 12:53:43.947010 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 26 12:53:43.947010 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 26 12:53:43.947010 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi raise error May 26 12:53:43.947010 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 26 12:53:43.947010 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:53:43.947010 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 26 12:53:43.947010 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 26 12:53:43.947010 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:53:43.947010 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi On instance['volume']: May 26 12:53:43.947010 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi '0' May 26 12:53:43.947010 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:53:43.947010 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:53:43.947010 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:53:43.947010 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:53:43.947010 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:53:43.947010 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:53:43.947010 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:53:43.947010 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:53:43.948354 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 12:53:43.948354 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 12:53:43.948354 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:53:43.948354 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:53:43.948354 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 26 12:53:43.948354 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 26 12:53:43.948354 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 26 12:53:43.948354 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 26 12:53:43.948354 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 26 12:53:43.948354 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 26 12:53:43.948354 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 26 12:53:43.948354 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:53:43.948354 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:53:43.948354 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:53:43.948354 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:53:43.948354 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:53:43.948354 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:53:43.948354 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 26 12:53:43.948354 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 26 12:53:43.950530 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 26 12:53:43.950530 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:53:43.950530 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-244ba4ea-1de7-4a1e-a6b8-157523a9925e tempest-VolumesNegativeTest-816160347 tempest-VolumesNegativeTest-816160347-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124823) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:53:43.950530 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-244ba4ea-1de7-4a1e-a6b8-157523a9925e tempest-VolumesNegativeTest-816160347 tempest-VolumesNegativeTest-816160347-project] 10.222.0.41 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.014054 May 26 12:53:43.950530 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 384/761] 10.222.0.41 () {60 vars in 1155 bytes} [Thu May 26 12:53:43 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 26 12:53:43.962770 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-0fa1c29c-8ae7-40e2-8955-47505cf5b239 tempest-VolumesNegativeTest-816160347 tempest-VolumesNegativeTest-816160347-project] Action: 'create', calling method: .version_select at 0x7f26a1e41160>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-139512343", "metadata": {"Type": "work"}}} {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:53:43.966050 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-0fa1c29c-8ae7-40e2-8955-47505cf5b239 tempest-VolumesNegativeTest-816160347 tempest-VolumesNegativeTest-816160347-project] Request method failure captured: May 26 12:53:43.966050 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 26 12:53:43.966050 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Accept: application/json May 26 12:53:43.966050 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Accept-Encoding: identity May 26 12:53:43.966050 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Connection: close May 26 12:53:43.966050 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Content-Length: 118 May 26 12:53:43.966050 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Content-Type: application/json May 26 12:53:43.966050 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Host: 10.222.0.41 May 26 12:53:43.966050 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Openstack-System-Scope: None May 26 12:53:43.966050 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: User-Agent: python-urllib3/1.26.9 May 26 12:53:43.966050 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Auth-Token: gAAAAABij3hXMtiRzHEEQC3DxN_sg8eh1e1_4uHDN7nj178Y3L29nKzePP_r62xLbtVEuDzuvrxbB6rt-eJqN5QysTpcvl9-DykMDH5GfTnK-YZJX-1TfJIfI6wF-uca-ovglFRwnBe3xKQ9CkwMXLCvDXS5XpmuSJnhITR2x4GHOOsP24mCymY May 26 12:53:43.966050 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Domain-Id: None May 26 12:53:43.966050 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Domain-Name: None May 26 12:53:43.966050 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Identity-Status: Confirmed May 26 12:53:43.966050 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Is-Admin-Project: True May 26 12:53:43.966050 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Domain-Id: default May 26 12:53:43.966050 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Domain-Name: Default May 26 12:53:43.966050 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Id: 650fa64e79474bb0a55fc1ecbcf422ec May 26 12:53:43.966050 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Name: tempest-VolumesNegativeTest-816160347 May 26 12:53:43.966050 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Role: member,reader May 26 12:53:43.966050 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Roles: member,reader May 26 12:53:43.967610 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/650fa64e79474bb0a55fc1ecbcf422ec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/650fa64e79474bb0a55fc1ecbcf422ec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/650fa64e79474bb0a55fc1ecbcf422ec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_650fa64e79474bb0a55fc1ecbcf422ec", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 26 12:53:43.967610 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Tenant: tempest-VolumesNegativeTest-816160347 May 26 12:53:43.967610 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Tenant-Id: 650fa64e79474bb0a55fc1ecbcf422ec May 26 12:53:43.967610 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Tenant-Name: tempest-VolumesNegativeTest-816160347 May 26 12:53:43.967610 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User: tempest-VolumesNegativeTest-816160347-project May 26 12:53:43.967610 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Domain-Id: default May 26 12:53:43.967610 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Domain-Name: Default May 26 12:53:43.967610 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Id: d86d99b601ce4c67994d3dc5de21eab2 May 26 12:53:43.967610 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Name: tempest-VolumesNegativeTest-816160347-project May 26 12:53:43.967610 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: May 26 12:53:43.967610 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-139512343", "metadata": {"Type": "work"}}} May 26 12:53:43.967610 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: method: May 26 12:53:43.967610 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 26 12:53:43.968408 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-139512343', 'metadata': {'Type': 'work'}}}} May 26 12:53:43.968408 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:53:43.968408 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:53:43.968408 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 26 12:53:43.968408 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 26 12:53:43.968408 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 26 12:53:43.968408 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi raise error May 26 12:53:43.968408 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 26 12:53:43.968408 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:53:43.968408 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 26 12:53:43.968408 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 26 12:53:43.968408 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:53:43.968408 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi On instance['volume']: May 26 12:53:43.968408 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi '' May 26 12:53:43.968408 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:53:43.968408 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:53:43.968408 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:53:43.968408 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:53:43.968408 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:53:43.968408 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:53:43.968408 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:53:43.968408 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:53:43.970095 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 12:53:43.970095 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 12:53:43.970095 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:53:43.970095 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:53:43.970095 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 26 12:53:43.970095 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 26 12:53:43.970095 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 26 12:53:43.970095 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 26 12:53:43.970095 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 26 12:53:43.970095 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 26 12:53:43.970095 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 26 12:53:43.970095 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:53:43.970095 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:53:43.970095 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:53:43.970095 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:53:43.970095 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:53:43.970095 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:53:43.970095 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 26 12:53:43.970095 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 26 12:53:43.971490 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 26 12:53:43.971490 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:53:43.971490 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-0fa1c29c-8ae7-40e2-8955-47505cf5b239 tempest-VolumesNegativeTest-816160347 tempest-VolumesNegativeTest-816160347-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124824) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:53:43.971490 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-0fa1c29c-8ae7-40e2-8955-47505cf5b239 tempest-VolumesNegativeTest-816160347 tempest-VolumesNegativeTest-816160347-project] 10.222.0.41 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010247 May 26 12:53:43.971490 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 378/762] 10.222.0.41 () {60 vars in 1155 bytes} [Thu May 26 12:53:43 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 26 12:53:43.987071 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-dab40d70-db7c-48d1-919a-24f10eef36ea tempest-VolumesNegativeTest-816160347 tempest-VolumesNegativeTest-816160347-project] Calling method '.version_select at 0x7f26a1da9310>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:44.035838 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.wsgi [None req-dab40d70-db7c-48d1-919a-24f10eef36ea tempest-VolumesNegativeTest-816160347 tempest-VolumesNegativeTest-816160347-project] HTTP exception thrown: Volume tempest-invalid-262438792 could not be found. May 26 12:53:44.037837 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-dab40d70-db7c-48d1-919a-24f10eef36ea tempest-VolumesNegativeTest-816160347 tempest-VolumesNegativeTest-816160347-project] Request method failure captured: May 26 12:53:44.037837 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-262438792 HTTP/1.1 May 26 12:53:44.037837 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Accept: application/json May 26 12:53:44.037837 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Accept-Encoding: identity May 26 12:53:44.037837 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Connection: close May 26 12:53:44.037837 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Content-Length: 0 May 26 12:53:44.037837 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Content-Type: application/json May 26 12:53:44.037837 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Host: 10.222.0.41 May 26 12:53:44.037837 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Openstack-System-Scope: None May 26 12:53:44.037837 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: User-Agent: python-urllib3/1.26.9 May 26 12:53:44.037837 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Auth-Token: gAAAAABij3hXMtiRzHEEQC3DxN_sg8eh1e1_4uHDN7nj178Y3L29nKzePP_r62xLbtVEuDzuvrxbB6rt-eJqN5QysTpcvl9-DykMDH5GfTnK-YZJX-1TfJIfI6wF-uca-ovglFRwnBe3xKQ9CkwMXLCvDXS5XpmuSJnhITR2x4GHOOsP24mCymY May 26 12:53:44.037837 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Domain-Id: None May 26 12:53:44.037837 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Domain-Name: None May 26 12:53:44.037837 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Identity-Status: Confirmed May 26 12:53:44.037837 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Is-Admin-Project: True May 26 12:53:44.037837 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Project-Domain-Id: default May 26 12:53:44.037837 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Project-Domain-Name: Default May 26 12:53:44.037837 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Project-Id: 650fa64e79474bb0a55fc1ecbcf422ec May 26 12:53:44.037837 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Project-Name: tempest-VolumesNegativeTest-816160347 May 26 12:53:44.037837 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Role: member,reader May 26 12:53:44.037837 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Roles: member,reader May 26 12:53:44.039410 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/650fa64e79474bb0a55fc1ecbcf422ec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/650fa64e79474bb0a55fc1ecbcf422ec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/650fa64e79474bb0a55fc1ecbcf422ec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_650fa64e79474bb0a55fc1ecbcf422ec", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 26 12:53:44.039410 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Tenant: tempest-VolumesNegativeTest-816160347 May 26 12:53:44.039410 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Tenant-Id: 650fa64e79474bb0a55fc1ecbcf422ec May 26 12:53:44.039410 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Tenant-Name: tempest-VolumesNegativeTest-816160347 May 26 12:53:44.039410 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User: tempest-VolumesNegativeTest-816160347-project May 26 12:53:44.039410 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User-Domain-Id: default May 26 12:53:44.039410 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User-Domain-Name: Default May 26 12:53:44.039410 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User-Id: d86d99b601ce4c67994d3dc5de21eab2 May 26 12:53:44.039410 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User-Name: tempest-VolumesNegativeTest-816160347-project May 26 12:53:44.039410 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: method: May 26 12:53:44.039410 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: exception: Volume tempest-invalid-262438792 could not be found. May 26 12:53:44.039410 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: action_args: {'id': 'tempest-invalid-262438792'} May 26 12:53:44.039410 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:53:44.039410 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:53:44.040316 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 12:53:44.040316 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 12:53:44.040316 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 26 12:53:44.040316 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 26 12:53:44.040316 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 26 12:53:44.040316 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 26 12:53:44.040316 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 26 12:53:44.040316 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 26 12:53:44.040316 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 26 12:53:44.040316 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 26 12:53:44.040316 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 12:53:44.040316 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 12:53:44.040316 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 12:53:44.040316 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 12:53:44.040316 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-262438792 could not be found. (HTTP 404) (Request-ID: req-43dfc66e-d29a-4a49-8eb5-008d9fae8b42) May 26 12:53:44.040316 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:53:44.040316 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:53:44.040316 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:53:44.040316 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:53:44.041942 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 26 12:53:44.041942 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 26 12:53:44.041942 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 12:53:44.041942 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 12:53:44.041942 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 12:53:44.041942 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 12:53:44.041942 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 12:53:44.041942 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 12:53:44.041942 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 12:53:44.041942 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 12:53:44.041942 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 26 12:53:44.041942 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 26 12:53:44.041942 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 26 12:53:44.041942 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 26 12:53:44.041942 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 26 12:53:44.041942 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 26 12:53:44.041942 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 26 12:53:44.041942 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 26 12:53:44.041942 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 12:53:44.043614 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 12:53:44.043614 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 12:53:44.043614 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 12:53:44.043614 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-262438792 could not be found. May 26 12:53:44.043614 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:53:44.043614 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:53:44.043614 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:53:44.043614 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:53:44.043614 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:53:44.043614 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:53:44.043614 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:53:44.043614 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:53:44.043614 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 12:53:44.043614 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 12:53:44.043614 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:53:44.043614 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:53:44.043614 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 26 12:53:44.043614 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:53:44.043614 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-262438792 could not be found. May 26 12:53:44.043614 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:53:44.043614 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:53:44.045874 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:53:44.045874 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:53:44.045874 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:53:44.045874 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:53:44.045874 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:53:44.045874 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:53:44.045874 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-262438792 could not be found. May 26 12:53:44.045874 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:53:44.047865 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-dab40d70-db7c-48d1-919a-24f10eef36ea tempest-VolumesNegativeTest-816160347 tempest-VolumesNegativeTest-816160347-project] Returning 404 to user: Volume tempest-invalid-262438792 could not be found. {{(pid=124823) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:53:44.048767 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-dab40d70-db7c-48d1-919a-24f10eef36ea tempest-VolumesNegativeTest-816160347 tempest-VolumesNegativeTest-816160347-project] 10.222.0.41 "DELETE /compute/v2.1/os-volumes/tempest-invalid-262438792" status: 404 len: 98 microversion: 2.1 time: 0.070468 May 26 12:53:44.049679 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 385/763] 10.222.0.41 () {58 vars in 1214 bytes} [Thu May 26 12:53:43 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-262438792 => generated 98 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 26 12:53:44.063551 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-96131f77-3795-4975-8e41-1894cb9daaa5 tempest-VolumesNegativeTest-816160347 tempest-VolumesNegativeTest-816160347-project] 10.222.0.41 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005316 May 26 12:53:44.064712 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 379/764] 10.222.0.41 () {58 vars in 1139 bytes} [Thu May 26 12:53:44 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) May 26 12:53:44.091506 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-8f38c8e8-5fc9-4b15-8965-166666227162 tempest-VolumesNegativeTest-816160347 tempest-VolumesNegativeTest-816160347-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.016275 May 26 12:53:44.099219 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 386/765] 10.222.0.41 () {58 vars in 1136 bytes} [Thu May 26 12:53:44 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 25 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 26 12:53:44.105344 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-26a183f4-d991-4fbd-a42c-50683b2af4a4 tempest-VolumesNegativeTest-816160347 tempest-VolumesNegativeTest-816160347-project] Calling method '.version_select at 0x7f26a1d683a0>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:44.122728 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-7f7ce44c-9dca-4490-a6cd-91177a439e8e tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:44.123988 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-7f7ce44c-9dca-4490-a6cd-91177a439e8e tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] [instance: d1efb756-8e30-4c05-9156-de4ae119ac3c] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:44.132279 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-7f7ce44c-9dca-4490-a6cd-91177a439e8e tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:44.132829 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-7f7ce44c-9dca-4490-a6cd-91177a439e8e tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:44.133751 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-7f7ce44c-9dca-4490-a6cd-91177a439e8e tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:44.134411 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-7f7ce44c-9dca-4490-a6cd-91177a439e8e tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:44.163995 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.wsgi [None req-26a183f4-d991-4fbd-a42c-50683b2af4a4 tempest-VolumesNegativeTest-816160347 tempest-VolumesNegativeTest-816160347-project] HTTP exception thrown: Volume f25b56bb-80e7-44dd-9f8a-085189c21899 could not be found. May 26 12:53:44.166187 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-26a183f4-d991-4fbd-a42c-50683b2af4a4 tempest-VolumesNegativeTest-816160347 tempest-VolumesNegativeTest-816160347-project] Request method failure captured: May 26 12:53:44.166187 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: request: DELETE /compute/v2.1/os-volumes/f25b56bb-80e7-44dd-9f8a-085189c21899 HTTP/1.1 May 26 12:53:44.166187 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Accept: application/json May 26 12:53:44.166187 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Accept-Encoding: identity May 26 12:53:44.166187 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Connection: close May 26 12:53:44.166187 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Content-Length: 0 May 26 12:53:44.166187 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Content-Type: application/json May 26 12:53:44.166187 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Host: 10.222.0.41 May 26 12:53:44.166187 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Openstack-System-Scope: None May 26 12:53:44.166187 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: User-Agent: python-urllib3/1.26.9 May 26 12:53:44.166187 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Auth-Token: gAAAAABij3hXMtiRzHEEQC3DxN_sg8eh1e1_4uHDN7nj178Y3L29nKzePP_r62xLbtVEuDzuvrxbB6rt-eJqN5QysTpcvl9-DykMDH5GfTnK-YZJX-1TfJIfI6wF-uca-ovglFRwnBe3xKQ9CkwMXLCvDXS5XpmuSJnhITR2x4GHOOsP24mCymY May 26 12:53:44.166187 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Domain-Id: None May 26 12:53:44.166187 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Domain-Name: None May 26 12:53:44.166187 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Identity-Status: Confirmed May 26 12:53:44.166187 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Is-Admin-Project: True May 26 12:53:44.166187 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Domain-Id: default May 26 12:53:44.166187 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Domain-Name: Default May 26 12:53:44.166187 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Id: 650fa64e79474bb0a55fc1ecbcf422ec May 26 12:53:44.166187 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Name: tempest-VolumesNegativeTest-816160347 May 26 12:53:44.166187 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Role: member,reader May 26 12:53:44.166187 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Roles: member,reader May 26 12:53:44.167802 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/650fa64e79474bb0a55fc1ecbcf422ec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/650fa64e79474bb0a55fc1ecbcf422ec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/650fa64e79474bb0a55fc1ecbcf422ec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_650fa64e79474bb0a55fc1ecbcf422ec", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 26 12:53:44.167802 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Tenant: tempest-VolumesNegativeTest-816160347 May 26 12:53:44.167802 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Tenant-Id: 650fa64e79474bb0a55fc1ecbcf422ec May 26 12:53:44.167802 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Tenant-Name: tempest-VolumesNegativeTest-816160347 May 26 12:53:44.167802 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User: tempest-VolumesNegativeTest-816160347-project May 26 12:53:44.167802 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Domain-Id: default May 26 12:53:44.167802 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Domain-Name: Default May 26 12:53:44.167802 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Id: d86d99b601ce4c67994d3dc5de21eab2 May 26 12:53:44.167802 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Name: tempest-VolumesNegativeTest-816160347-project May 26 12:53:44.167802 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: method: May 26 12:53:44.167802 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: exception: Volume f25b56bb-80e7-44dd-9f8a-085189c21899 could not be found. May 26 12:53:44.167802 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: action_args: {'id': 'f25b56bb-80e7-44dd-9f8a-085189c21899'} May 26 12:53:44.167802 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:53:44.168578 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:53:44.168578 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 12:53:44.168578 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 12:53:44.168578 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 26 12:53:44.168578 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 26 12:53:44.168578 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 26 12:53:44.168578 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 26 12:53:44.168578 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 26 12:53:44.168578 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 26 12:53:44.168578 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 26 12:53:44.168578 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 26 12:53:44.168578 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 12:53:44.168578 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 12:53:44.168578 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 12:53:44.168578 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 12:53:44.168578 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f25b56bb-80e7-44dd-9f8a-085189c21899 could not be found. (HTTP 404) (Request-ID: req-6fca5885-1778-4549-a516-c91f14cb5ff4) May 26 12:53:44.168578 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:53:44.168578 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:53:44.168578 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:53:44.169718 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:53:44.169718 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 26 12:53:44.169718 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 26 12:53:44.169718 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 12:53:44.169718 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 12:53:44.169718 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 12:53:44.169718 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 12:53:44.169718 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 12:53:44.169718 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 12:53:44.169718 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 12:53:44.169718 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 12:53:44.169718 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 26 12:53:44.169718 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 26 12:53:44.169718 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 26 12:53:44.169718 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 26 12:53:44.169718 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 26 12:53:44.169718 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 26 12:53:44.169718 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 26 12:53:44.169718 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 26 12:53:44.171654 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 12:53:44.171654 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 12:53:44.171654 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 12:53:44.171654 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 12:53:44.171654 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f25b56bb-80e7-44dd-9f8a-085189c21899 could not be found. May 26 12:53:44.171654 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:53:44.171654 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:53:44.171654 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:53:44.171654 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:53:44.171654 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:53:44.171654 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:53:44.171654 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:53:44.171654 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:53:44.171654 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 12:53:44.171654 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 12:53:44.171654 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:53:44.171654 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:53:44.171654 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 26 12:53:44.171654 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:53:44.171654 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f25b56bb-80e7-44dd-9f8a-085189c21899 could not be found. May 26 12:53:44.172835 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:53:44.172835 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:53:44.172835 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:53:44.172835 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:53:44.172835 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:53:44.172835 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:53:44.172835 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:53:44.172835 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:53:44.172835 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f25b56bb-80e7-44dd-9f8a-085189c21899 could not be found. May 26 12:53:44.172835 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:53:44.172835 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-26a183f4-d991-4fbd-a42c-50683b2af4a4 tempest-VolumesNegativeTest-816160347 tempest-VolumesNegativeTest-816160347-project] Returning 404 to user: Volume f25b56bb-80e7-44dd-9f8a-085189c21899 could not be found. {{(pid=124824) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:53:44.172835 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-26a183f4-d991-4fbd-a42c-50683b2af4a4 tempest-VolumesNegativeTest-816160347 tempest-VolumesNegativeTest-816160347-project] 10.222.0.41 "DELETE /compute/v2.1/os-volumes/f25b56bb-80e7-44dd-9f8a-085189c21899" status: 404 len: 109 microversion: 2.1 time: 0.067451 May 26 12:53:44.172835 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 380/766] 10.222.0.41 () {58 vars in 1247 bytes} [Thu May 26 12:53:44 2022] DELETE /compute/v2.1/os-volumes/f25b56bb-80e7-44dd-9f8a-085189c21899 => generated 109 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:53:44.185738 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-a0a284f3-ccda-46c3-9c6b-df85398a633a tempest-VolumesNegativeTest-816160347 tempest-VolumesNegativeTest-816160347-project] Calling method '.version_select at 0x7f26a1d68dc0>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:44.241386 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.wsgi [None req-a0a284f3-ccda-46c3-9c6b-df85398a633a tempest-VolumesNegativeTest-816160347 tempest-VolumesNegativeTest-816160347-project] HTTP exception thrown: Volume a7e28e5a-3213-43ea-972b-83e80e401774 could not be found. May 26 12:53:44.243719 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-a0a284f3-ccda-46c3-9c6b-df85398a633a tempest-VolumesNegativeTest-816160347 tempest-VolumesNegativeTest-816160347-project] Request method failure captured: May 26 12:53:44.243719 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: request: GET /compute/v2.1/os-volumes/a7e28e5a-3213-43ea-972b-83e80e401774 HTTP/1.1 May 26 12:53:44.243719 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Accept: application/json May 26 12:53:44.243719 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Accept-Encoding: identity May 26 12:53:44.243719 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Connection: close May 26 12:53:44.243719 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Content-Length: 0 May 26 12:53:44.243719 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Content-Type: application/json May 26 12:53:44.243719 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Host: 10.222.0.41 May 26 12:53:44.243719 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Openstack-System-Scope: None May 26 12:53:44.243719 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: User-Agent: python-urllib3/1.26.9 May 26 12:53:44.243719 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Auth-Token: gAAAAABij3hXMtiRzHEEQC3DxN_sg8eh1e1_4uHDN7nj178Y3L29nKzePP_r62xLbtVEuDzuvrxbB6rt-eJqN5QysTpcvl9-DykMDH5GfTnK-YZJX-1TfJIfI6wF-uca-ovglFRwnBe3xKQ9CkwMXLCvDXS5XpmuSJnhITR2x4GHOOsP24mCymY May 26 12:53:44.243719 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Domain-Id: None May 26 12:53:44.243719 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Domain-Name: None May 26 12:53:44.243719 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Identity-Status: Confirmed May 26 12:53:44.243719 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Is-Admin-Project: True May 26 12:53:44.243719 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Domain-Id: default May 26 12:53:44.243719 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Domain-Name: Default May 26 12:53:44.243719 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Id: 650fa64e79474bb0a55fc1ecbcf422ec May 26 12:53:44.243719 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Name: tempest-VolumesNegativeTest-816160347 May 26 12:53:44.243719 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Role: member,reader May 26 12:53:44.243719 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Roles: member,reader May 26 12:53:44.245400 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/650fa64e79474bb0a55fc1ecbcf422ec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/650fa64e79474bb0a55fc1ecbcf422ec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/650fa64e79474bb0a55fc1ecbcf422ec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_650fa64e79474bb0a55fc1ecbcf422ec", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 26 12:53:44.245400 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Tenant: tempest-VolumesNegativeTest-816160347 May 26 12:53:44.245400 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Tenant-Id: 650fa64e79474bb0a55fc1ecbcf422ec May 26 12:53:44.245400 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Tenant-Name: tempest-VolumesNegativeTest-816160347 May 26 12:53:44.245400 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User: tempest-VolumesNegativeTest-816160347-project May 26 12:53:44.245400 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Domain-Id: default May 26 12:53:44.245400 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Domain-Name: Default May 26 12:53:44.245400 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Id: d86d99b601ce4c67994d3dc5de21eab2 May 26 12:53:44.245400 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Name: tempest-VolumesNegativeTest-816160347-project May 26 12:53:44.245400 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: method: May 26 12:53:44.245400 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: exception: Volume a7e28e5a-3213-43ea-972b-83e80e401774 could not be found. May 26 12:53:44.245400 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: action_args: {'id': 'a7e28e5a-3213-43ea-972b-83e80e401774'} May 26 12:53:44.245400 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:53:44.246535 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:53:44.246535 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 12:53:44.246535 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 12:53:44.246535 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 12:53:44.246535 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 12:53:44.246535 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 12:53:44.246535 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 12:53:44.246535 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 12:53:44.246535 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 12:53:44.246535 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 12:53:44.246535 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 12:53:44.246535 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 12:53:44.246535 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 12:53:44.246535 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 12:53:44.246535 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 12:53:44.246535 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a7e28e5a-3213-43ea-972b-83e80e401774 could not be found. (HTTP 404) (Request-ID: req-e4af94f9-9c22-4eb7-aac1-feaf35973068) May 26 12:53:44.246535 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:53:44.246535 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:53:44.246535 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:53:44.247652 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:53:44.247652 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 26 12:53:44.247652 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 26 12:53:44.247652 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 12:53:44.247652 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 12:53:44.247652 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 12:53:44.247652 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 12:53:44.247652 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 12:53:44.247652 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 12:53:44.247652 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 12:53:44.247652 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 12:53:44.247652 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 12:53:44.247652 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 12:53:44.247652 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 12:53:44.247652 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 12:53:44.247652 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 12:53:44.247652 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 12:53:44.247652 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 12:53:44.247652 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 12:53:44.248876 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 12:53:44.248876 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 12:53:44.248876 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 12:53:44.248876 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 12:53:44.248876 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a7e28e5a-3213-43ea-972b-83e80e401774 could not be found. May 26 12:53:44.248876 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:53:44.248876 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:53:44.248876 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:53:44.248876 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:53:44.248876 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:53:44.248876 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:53:44.248876 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:53:44.248876 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:53:44.248876 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 12:53:44.248876 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 12:53:44.248876 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:53:44.248876 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:53:44.248876 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 26 12:53:44.248876 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:53:44.248876 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a7e28e5a-3213-43ea-972b-83e80e401774 could not be found. May 26 12:53:44.250863 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:53:44.250863 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:53:44.250863 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:53:44.250863 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:53:44.250863 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:53:44.250863 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:53:44.250863 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:53:44.250863 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:53:44.250863 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a7e28e5a-3213-43ea-972b-83e80e401774 could not be found. May 26 12:53:44.250863 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:53:44.250863 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-a0a284f3-ccda-46c3-9c6b-df85398a633a tempest-VolumesNegativeTest-816160347 tempest-VolumesNegativeTest-816160347-project] Returning 404 to user: Volume a7e28e5a-3213-43ea-972b-83e80e401774 could not be found. {{(pid=124824) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:53:44.250863 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-a0a284f3-ccda-46c3-9c6b-df85398a633a tempest-VolumesNegativeTest-816160347 tempest-VolumesNegativeTest-816160347-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/a7e28e5a-3213-43ea-972b-83e80e401774" status: 404 len: 109 microversion: 2.1 time: 0.064474 May 26 12:53:44.250863 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 381/767] 10.222.0.41 () {58 vars in 1244 bytes} [Thu May 26 12:53:44 2022] GET /compute/v2.1/os-volumes/a7e28e5a-3213-43ea-972b-83e80e401774 => generated 109 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 12:53:44.415527 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-7f7ce44c-9dca-4490-a6cd-91177a439e8e tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7277aedb35df448e8b3056f8bc395e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c876091609fe45ba80370a16748cbeb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:44.426543 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-7f7ce44c-9dca-4490-a6cd-91177a439e8e tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] 10.222.0.41 "GET /compute/v2.1/servers/d1efb756-8e30-4c05-9156-de4ae119ac3c" status: 200 len: 1359 microversion: 2.1 time: 0.310235 May 26 12:53:44.439788 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 387/768] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:53:44 2022] GET /compute/v2.1/servers/d1efb756-8e30-4c05-9156-de4ae119ac3c => generated 1359 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:53:45.447449 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-a3e2a4cf-b48d-41fb-94d4-ef274fc429b4 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:45.448936 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-a3e2a4cf-b48d-41fb-94d4-ef274fc429b4 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] [instance: d1efb756-8e30-4c05-9156-de4ae119ac3c] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:45.452718 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG dbcounter [-] [124824] Writing DB stats nova_api:SELECT=58,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=124824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:53:45.473892 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-a3e2a4cf-b48d-41fb-94d4-ef274fc429b4 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:45.474620 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-a3e2a4cf-b48d-41fb-94d4-ef274fc429b4 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:45.475585 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-a3e2a4cf-b48d-41fb-94d4-ef274fc429b4 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:45.476371 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-a3e2a4cf-b48d-41fb-94d4-ef274fc429b4 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:45.859336 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-a3e2a4cf-b48d-41fb-94d4-ef274fc429b4 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7277aedb35df448e8b3056f8bc395e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c876091609fe45ba80370a16748cbeb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:45.867806 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-a3e2a4cf-b48d-41fb-94d4-ef274fc429b4 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] 10.222.0.41 "GET /compute/v2.1/servers/d1efb756-8e30-4c05-9156-de4ae119ac3c" status: 200 len: 1359 microversion: 2.1 time: 0.426314 May 26 12:53:45.868936 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 382/769] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:53:45 2022] GET /compute/v2.1/servers/d1efb756-8e30-4c05-9156-de4ae119ac3c => generated 1359 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:53:46.885462 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-fdd47063-4435-41c5-97a6-39546f6bb3ea tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:46.886555 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-fdd47063-4435-41c5-97a6-39546f6bb3ea tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] [instance: d1efb756-8e30-4c05-9156-de4ae119ac3c] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:46.890765 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG dbcounter [-] [124823] Writing DB stats nova_cell0:SELECT=2 {{(pid=124823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:53:46.898596 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-fdd47063-4435-41c5-97a6-39546f6bb3ea tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:46.899036 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-fdd47063-4435-41c5-97a6-39546f6bb3ea tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:46.902245 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-fdd47063-4435-41c5-97a6-39546f6bb3ea tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:46.902245 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-fdd47063-4435-41c5-97a6-39546f6bb3ea tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:47.065956 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-fdd47063-4435-41c5-97a6-39546f6bb3ea tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7277aedb35df448e8b3056f8bc395e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c876091609fe45ba80370a16748cbeb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:47.071048 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG dbcounter [-] [124823] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:53:47.077271 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-fdd47063-4435-41c5-97a6-39546f6bb3ea tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] 10.222.0.41 "GET /compute/v2.1/servers/d1efb756-8e30-4c05-9156-de4ae119ac3c" status: 200 len: 1359 microversion: 2.1 time: 0.195509 May 26 12:53:47.078219 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 388/770] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:53:46 2022] GET /compute/v2.1/servers/d1efb756-8e30-4c05-9156-de4ae119ac3c => generated 1359 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:53:48.096930 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-4fac944f-eb79-412f-bd04-7aaadc77ec87 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:48.098923 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-4fac944f-eb79-412f-bd04-7aaadc77ec87 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] [instance: d1efb756-8e30-4c05-9156-de4ae119ac3c] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:48.101175 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG dbcounter [-] [124824] Writing DB stats nova_cell0:SELECT=2 {{(pid=124824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:53:48.109452 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-4fac944f-eb79-412f-bd04-7aaadc77ec87 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:48.110300 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-4fac944f-eb79-412f-bd04-7aaadc77ec87 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:48.111352 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-4fac944f-eb79-412f-bd04-7aaadc77ec87 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:48.112006 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-4fac944f-eb79-412f-bd04-7aaadc77ec87 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:48.277590 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-4fac944f-eb79-412f-bd04-7aaadc77ec87 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7277aedb35df448e8b3056f8bc395e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c876091609fe45ba80370a16748cbeb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:48.289201 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-4fac944f-eb79-412f-bd04-7aaadc77ec87 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] 10.222.0.41 "GET /compute/v2.1/servers/d1efb756-8e30-4c05-9156-de4ae119ac3c" status: 200 len: 1359 microversion: 2.1 time: 0.198245 May 26 12:53:48.290162 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 383/771] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:53:48 2022] GET /compute/v2.1/servers/d1efb756-8e30-4c05-9156-de4ae119ac3c => generated 1359 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:53:49.318161 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-1aab3f5a-8f51-4c8f-b141-3cfc28562054 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:49.318161 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-1aab3f5a-8f51-4c8f-b141-3cfc28562054 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] [instance: d1efb756-8e30-4c05-9156-de4ae119ac3c] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:49.318161 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG dbcounter [-] [124823] Writing DB stats nova_cell0:SELECT=12 {{(pid=124823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:53:49.318161 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-1aab3f5a-8f51-4c8f-b141-3cfc28562054 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:49.318161 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-1aab3f5a-8f51-4c8f-b141-3cfc28562054 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:49.318974 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-1aab3f5a-8f51-4c8f-b141-3cfc28562054 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:49.319254 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-1aab3f5a-8f51-4c8f-b141-3cfc28562054 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:49.454085 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-1aab3f5a-8f51-4c8f-b141-3cfc28562054 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7277aedb35df448e8b3056f8bc395e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c876091609fe45ba80370a16748cbeb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:49.461560 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-1aab3f5a-8f51-4c8f-b141-3cfc28562054 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] 10.222.0.41 "GET /compute/v2.1/servers/d1efb756-8e30-4c05-9156-de4ae119ac3c" status: 200 len: 1359 microversion: 2.1 time: 0.157151 May 26 12:53:49.462894 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 389/772] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:53:49 2022] GET /compute/v2.1/servers/d1efb756-8e30-4c05-9156-de4ae119ac3c => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:53:50.480891 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-05b59191-2986-4673-beef-5a11b00cc559 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:50.480891 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-05b59191-2986-4673-beef-5a11b00cc559 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] [instance: d1efb756-8e30-4c05-9156-de4ae119ac3c] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:50.486526 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-05b59191-2986-4673-beef-5a11b00cc559 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:50.486969 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-05b59191-2986-4673-beef-5a11b00cc559 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:50.487720 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-05b59191-2986-4673-beef-5a11b00cc559 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:50.488151 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-05b59191-2986-4673-beef-5a11b00cc559 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:50.620449 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-05b59191-2986-4673-beef-5a11b00cc559 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7277aedb35df448e8b3056f8bc395e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c876091609fe45ba80370a16748cbeb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:50.628989 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-05b59191-2986-4673-beef-5a11b00cc559 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] 10.222.0.41 "GET /compute/v2.1/servers/d1efb756-8e30-4c05-9156-de4ae119ac3c" status: 200 len: 1359 microversion: 2.1 time: 0.154068 May 26 12:53:50.629945 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 384/773] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:53:50 2022] GET /compute/v2.1/servers/d1efb756-8e30-4c05-9156-de4ae119ac3c => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:53:51.647756 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-7446c56f-fe73-455d-83d5-b1b5e8696aa8 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:51.648992 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-7446c56f-fe73-455d-83d5-b1b5e8696aa8 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] [instance: d1efb756-8e30-4c05-9156-de4ae119ac3c] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:51.652719 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG dbcounter [-] [124823] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=124823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:53:51.658580 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-7446c56f-fe73-455d-83d5-b1b5e8696aa8 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:51.659854 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-7446c56f-fe73-455d-83d5-b1b5e8696aa8 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:51.661209 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-7446c56f-fe73-455d-83d5-b1b5e8696aa8 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:51.662234 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-7446c56f-fe73-455d-83d5-b1b5e8696aa8 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:51.870835 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-7446c56f-fe73-455d-83d5-b1b5e8696aa8 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7277aedb35df448e8b3056f8bc395e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c876091609fe45ba80370a16748cbeb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:51.881042 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-7446c56f-fe73-455d-83d5-b1b5e8696aa8 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] 10.222.0.41 "GET /compute/v2.1/servers/d1efb756-8e30-4c05-9156-de4ae119ac3c" status: 200 len: 1359 microversion: 2.1 time: 0.238224 May 26 12:53:51.891602 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 390/774] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:53:51 2022] GET /compute/v2.1/servers/d1efb756-8e30-4c05-9156-de4ae119ac3c => generated 1359 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:53:52.899887 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-7acc78b7-d1ff-411f-8651-f60cae9fa62b tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:52.899887 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-7acc78b7-d1ff-411f-8651-f60cae9fa62b tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] [instance: d1efb756-8e30-4c05-9156-de4ae119ac3c] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:52.918756 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-7acc78b7-d1ff-411f-8651-f60cae9fa62b tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:52.919199 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-7acc78b7-d1ff-411f-8651-f60cae9fa62b tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:52.920513 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-7acc78b7-d1ff-411f-8651-f60cae9fa62b tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:52.920950 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-7acc78b7-d1ff-411f-8651-f60cae9fa62b tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:53.126525 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-7acc78b7-d1ff-411f-8651-f60cae9fa62b tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7277aedb35df448e8b3056f8bc395e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c876091609fe45ba80370a16748cbeb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:53.141307 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-7acc78b7-d1ff-411f-8651-f60cae9fa62b tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] 10.222.0.41 "GET /compute/v2.1/servers/d1efb756-8e30-4c05-9156-de4ae119ac3c" status: 200 len: 1359 microversion: 2.1 time: 0.245866 May 26 12:53:53.142953 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 385/775] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:53:52 2022] GET /compute/v2.1/servers/d1efb756-8e30-4c05-9156-de4ae119ac3c => generated 1359 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:53:54.159036 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-11c44e39-f9be-4ee5-9ae6-45bbd449615d tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:54.160313 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-11c44e39-f9be-4ee5-9ae6-45bbd449615d tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] [instance: d1efb756-8e30-4c05-9156-de4ae119ac3c] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:54.168881 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-11c44e39-f9be-4ee5-9ae6-45bbd449615d tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:54.169693 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-11c44e39-f9be-4ee5-9ae6-45bbd449615d tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:54.170905 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-11c44e39-f9be-4ee5-9ae6-45bbd449615d tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:54.171344 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-11c44e39-f9be-4ee5-9ae6-45bbd449615d tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:54.326321 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-11c44e39-f9be-4ee5-9ae6-45bbd449615d tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7277aedb35df448e8b3056f8bc395e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c876091609fe45ba80370a16748cbeb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:54.337754 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-11c44e39-f9be-4ee5-9ae6-45bbd449615d tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] 10.222.0.41 "GET /compute/v2.1/servers/d1efb756-8e30-4c05-9156-de4ae119ac3c" status: 200 len: 1359 microversion: 2.1 time: 0.182375 May 26 12:53:54.339266 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 391/776] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:53:54 2022] GET /compute/v2.1/servers/d1efb756-8e30-4c05-9156-de4ae119ac3c => generated 1359 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:53:54.566915 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [req-b2dc3c5e-def2-4fad-8b80-8649a2dc7f11 req-0e883c88-c01f-423f-8567-8be16c0ed74d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1efb756-8e30-4c05-9156-de4ae119ac3c", "name": "network-vif-plugged", "status": "completed", "tag": "114a1a6a-836f-4257-81d6-756de175e28e"}]} {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:53:54.580232 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [req-b2dc3c5e-def2-4fad-8b80-8649a2dc7f11 req-0e883c88-c01f-423f-8567-8be16c0ed74d service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:54.580932 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [req-b2dc3c5e-def2-4fad-8b80-8649a2dc7f11 req-0e883c88-c01f-423f-8567-8be16c0ed74d service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:54.593692 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.compute.server_external_events [req-b2dc3c5e-def2-4fad-8b80-8649a2dc7f11 req-0e883c88-c01f-423f-8567-8be16c0ed74d service nova] Creating event network-vif-plugged:114a1a6a-836f-4257-81d6-756de175e28e for instance d1efb756-8e30-4c05-9156-de4ae119ac3c on hv-cinder-81571 May 26 12:53:54.599288 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [req-b2dc3c5e-def2-4fad-8b80-8649a2dc7f11 req-0e883c88-c01f-423f-8567-8be16c0ed74d service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036141 May 26 12:53:54.603543 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 386/777] 10.222.0.41 () {64 vars in 1317 bytes} [Thu May 26 12:53:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:53:55.355622 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-2a545936-433c-4702-8b15-ee3de543dd2b tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:55.356963 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-2a545936-433c-4702-8b15-ee3de543dd2b tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] [instance: d1efb756-8e30-4c05-9156-de4ae119ac3c] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:55.364708 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-2a545936-433c-4702-8b15-ee3de543dd2b tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:55.365176 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-2a545936-433c-4702-8b15-ee3de543dd2b tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:55.366159 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-2a545936-433c-4702-8b15-ee3de543dd2b tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:55.366615 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-2a545936-433c-4702-8b15-ee3de543dd2b tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:55.544289 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-2a545936-433c-4702-8b15-ee3de543dd2b tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7277aedb35df448e8b3056f8bc395e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c876091609fe45ba80370a16748cbeb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:55.553365 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-2a545936-433c-4702-8b15-ee3de543dd2b tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] 10.222.0.41 "GET /compute/v2.1/servers/d1efb756-8e30-4c05-9156-de4ae119ac3c" status: 200 len: 1359 microversion: 2.1 time: 0.202543 May 26 12:53:55.554949 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 392/778] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:53:55 2022] GET /compute/v2.1/servers/d1efb756-8e30-4c05-9156-de4ae119ac3c => generated 1359 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:53:56.340486 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-ace7d6b2-9475-43ae-af38-87c69a5cb428 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Action: 'create', calling method: .version_select at 0x7f26a281cf70>, body: {"keypair": {"name": "tempest-keypair-2136351000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBkmOSWsTyEDuOhc8eHlOAXDHALSfqk8goE3NTWSMoCKJhPf0VkUpvAbI0D4TlKYvZorJ0g+GJUr+c79Jmneba3ibjo2upfJMksAxCdd1bzGcLH3y1a28DO2soggCHIofQ=="}} {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:53:56.354852 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.quota [None req-ace7d6b2-9475-43ae-af38-87c69a5cb428 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Getting quotas for project cbe580a28eae4195be1491ac29d373a7. Resources: {'key_pairs'} {{(pid=124824) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:53:56.359500 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.quota [None req-ace7d6b2-9475-43ae-af38-87c69a5cb428 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Getting quotas for user aa52505a079041efbbf14fb04da7ac7f and project cbe580a28eae4195be1491ac29d373a7. Resources: {'key_pairs'} {{(pid=124824) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:53:56.473715 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-ace7d6b2-9475-43ae-af38-87c69a5cb428 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.245854 May 26 12:53:56.474300 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 387/779] 10.222.0.41 () {60 vars in 1158 bytes} [Thu May 26 12:53:56 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:53:56.572454 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-7b153696-47c9-4d2e-ba75-85b619d11140 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:56.573248 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-7b153696-47c9-4d2e-ba75-85b619d11140 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] [instance: d1efb756-8e30-4c05-9156-de4ae119ac3c] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:56.581851 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-7b153696-47c9-4d2e-ba75-85b619d11140 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:56.582793 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-7b153696-47c9-4d2e-ba75-85b619d11140 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:56.583980 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-7b153696-47c9-4d2e-ba75-85b619d11140 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:56.584670 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-7b153696-47c9-4d2e-ba75-85b619d11140 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:56.773438 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-7b153696-47c9-4d2e-ba75-85b619d11140 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7277aedb35df448e8b3056f8bc395e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c876091609fe45ba80370a16748cbeb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:56.782062 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-7b153696-47c9-4d2e-ba75-85b619d11140 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] 10.222.0.41 "GET /compute/v2.1/servers/d1efb756-8e30-4c05-9156-de4ae119ac3c" status: 200 len: 1359 microversion: 2.1 time: 0.214667 May 26 12:53:56.785727 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 393/780] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:53:56 2022] GET /compute/v2.1/servers/d1efb756-8e30-4c05-9156-de4ae119ac3c => generated 1359 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:53:57.800362 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-ed942176-9488-4a03-9183-60062a3724e0 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:57.801200 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-ed942176-9488-4a03-9183-60062a3724e0 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] [instance: d1efb756-8e30-4c05-9156-de4ae119ac3c] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:57.810177 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-ed942176-9488-4a03-9183-60062a3724e0 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:57.810728 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-ed942176-9488-4a03-9183-60062a3724e0 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:57.811580 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-ed942176-9488-4a03-9183-60062a3724e0 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:57.812249 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-ed942176-9488-4a03-9183-60062a3724e0 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:58.096217 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-ed942176-9488-4a03-9183-60062a3724e0 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7277aedb35df448e8b3056f8bc395e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c876091609fe45ba80370a16748cbeb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:58.108030 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-ed942176-9488-4a03-9183-60062a3724e0 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] 10.222.0.41 "GET /compute/v2.1/servers/d1efb756-8e30-4c05-9156-de4ae119ac3c" status: 200 len: 1550 microversion: 2.1 time: 0.309792 May 26 12:53:58.120815 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 388/781] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:53:57 2022] GET /compute/v2.1/servers/d1efb756-8e30-4c05-9156-de4ae119ac3c => generated 1550 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:53:58.127499 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-58d9c17a-2715-4a74-9195-7936bbd20799 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:58.128049 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-58d9c17a-2715-4a74-9195-7936bbd20799 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] [instance: d1efb756-8e30-4c05-9156-de4ae119ac3c] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:58.146349 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-58d9c17a-2715-4a74-9195-7936bbd20799 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:58.150792 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-58d9c17a-2715-4a74-9195-7936bbd20799 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:58.152964 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-58d9c17a-2715-4a74-9195-7936bbd20799 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:58.154902 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-58d9c17a-2715-4a74-9195-7936bbd20799 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:58.353893 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-58d9c17a-2715-4a74-9195-7936bbd20799 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7277aedb35df448e8b3056f8bc395e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c876091609fe45ba80370a16748cbeb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:58.363065 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-58d9c17a-2715-4a74-9195-7936bbd20799 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] 10.222.0.41 "GET /compute/v2.1/servers/d1efb756-8e30-4c05-9156-de4ae119ac3c" status: 200 len: 1550 microversion: 2.1 time: 0.239757 May 26 12:53:58.364910 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 394/782] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:53:58 2022] GET /compute/v2.1/servers/d1efb756-8e30-4c05-9156-de4ae119ac3c => generated 1550 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:53:58.380259 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-6e8fd303-b7d8-4bbf-a95b-988a447a17d2 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:58.383613 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-6e8fd303-b7d8-4bbf-a95b-988a447a17d2 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7277aedb35df448e8b3056f8bc395e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c876091609fe45ba80370a16748cbeb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:58.384426 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-6e8fd303-b7d8-4bbf-a95b-988a447a17d2 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Searching by: {'deleted': False, 'project_id': 'c876091609fe45ba80370a16748cbeb2'} {{(pid=124824) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 26 12:53:58.391643 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-6e8fd303-b7d8-4bbf-a95b-988a447a17d2 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:58.392084 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-6e8fd303-b7d8-4bbf-a95b-988a447a17d2 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:58.392869 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-6e8fd303-b7d8-4bbf-a95b-988a447a17d2 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:58.393301 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-6e8fd303-b7d8-4bbf-a95b-988a447a17d2 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:58.486934 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.multi_cell_list [None req-6e8fd303-b7d8-4bbf-a95b-988a447a17d2 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124824) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 26 12:53:58.606875 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-6e8fd303-b7d8-4bbf-a95b-988a447a17d2 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] 10.222.0.41 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.230271 May 26 12:53:58.618075 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 389/783] 10.222.0.41 () {58 vars in 1124 bytes} [Thu May 26 12:53:58 2022] GET /compute/v2.1/servers => generated 343 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:53:58.628773 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-ad8dfd78-86ce-43f1-a6d2-3084cfb478b4 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:58.629416 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-ad8dfd78-86ce-43f1-a6d2-3084cfb478b4 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] [instance: d1efb756-8e30-4c05-9156-de4ae119ac3c] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:58.639921 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-ad8dfd78-86ce-43f1-a6d2-3084cfb478b4 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:58.641186 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-ad8dfd78-86ce-43f1-a6d2-3084cfb478b4 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:58.642253 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-ad8dfd78-86ce-43f1-a6d2-3084cfb478b4 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:58.642891 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-ad8dfd78-86ce-43f1-a6d2-3084cfb478b4 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:58.897307 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-ad8dfd78-86ce-43f1-a6d2-3084cfb478b4 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7277aedb35df448e8b3056f8bc395e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c876091609fe45ba80370a16748cbeb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:58.905962 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-ad8dfd78-86ce-43f1-a6d2-3084cfb478b4 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] 10.222.0.41 "GET /compute/v2.1/servers/d1efb756-8e30-4c05-9156-de4ae119ac3c" status: 200 len: 1550 microversion: 2.1 time: 0.281082 May 26 12:53:58.906875 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 395/784] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:53:58 2022] GET /compute/v2.1/servers/d1efb756-8e30-4c05-9156-de4ae119ac3c => generated 1550 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:53:59.332998 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-6fa3d436-a85e-4f51-ac8f-f15d7a93d8f6 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:59.333493 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-6fa3d436-a85e-4f51-ac8f-f15d7a93d8f6 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] [instance: 2b1f3f01-d549-4e51-ae06-24500312482c] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:59.340544 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-6fa3d436-a85e-4f51-ac8f-f15d7a93d8f6 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:59.340997 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-6fa3d436-a85e-4f51-ac8f-f15d7a93d8f6 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:59.342313 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-6fa3d436-a85e-4f51-ac8f-f15d7a93d8f6 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:59.342748 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-6fa3d436-a85e-4f51-ac8f-f15d7a93d8f6 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:59.370544 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-6fa3d436-a85e-4f51-ac8f-f15d7a93d8f6 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] [instance: 2b1f3f01-d549-4e51-ae06-24500312482c] Going to try to terminate instance {{(pid=124824) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 12:53:59.441916 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-2dc79562-dd95-455a-a2ba-8bdf5b29e0e3 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1587855309", "imageRef": "6df25342-b071-489b-a7c1-3089fa19af6d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "eb415de3-e6dc-4384-aaf7-8dbb57dc125b"}], "security_groups": [{"name": "tempest-securitygroup--1163494296"}], "key_name": "tempest-keypair-2136351000", "user_data": "}} {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:53:59.554576 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.network.neutron [None req-2dc79562-dd95-455a-a2ba-8bdf5b29e0e3 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] validate_networks() for [('eb415de3-e6dc-4384-aaf7-8dbb57dc125b', None, None, None, None, None)] {{(pid=124823) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 12:53:59.670568 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-6fa3d436-a85e-4f51-ac8f-f15d7a93d8f6 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] 10.222.0.41 "DELETE /compute/v2.1/servers/2b1f3f01-d549-4e51-ae06-24500312482c" status: 204 len: 0 microversion: 2.1 time: 0.341331 May 26 12:53:59.671389 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 390/785] 10.222.0.41 () {58 vars in 1238 bytes} [Thu May 26 12:53:59 2022] DELETE /compute/v2.1/servers/2b1f3f01-d549-4e51-ae06-24500312482c => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 12:53:59.679653 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-bd788375-7567-4b7e-aa7e-9292c68e5b8d tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:53:59.685499 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-bd788375-7567-4b7e-aa7e-9292c68e5b8d tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] [instance: 2b1f3f01-d549-4e51-ae06-24500312482c] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:53:59.687154 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-bd788375-7567-4b7e-aa7e-9292c68e5b8d tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:59.687766 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-bd788375-7567-4b7e-aa7e-9292c68e5b8d tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:59.688545 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-bd788375-7567-4b7e-aa7e-9292c68e5b8d tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:53:59.689167 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-bd788375-7567-4b7e-aa7e-9292c68e5b8d tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:53:59.916442 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-bd788375-7567-4b7e-aa7e-9292c68e5b8d tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47d51863b0448b880dc03b01dec6dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23568023763549669484e71430e34389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:53:59.942481 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-bd788375-7567-4b7e-aa7e-9292c68e5b8d tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] 10.222.0.41 "GET /compute/v2.1/servers/2b1f3f01-d549-4e51-ae06-24500312482c" status: 200 len: 1577 microversion: 2.1 time: 0.266756 May 26 12:53:59.944033 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 391/786] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:53:59 2022] GET /compute/v2.1/servers/2b1f3f01-d549-4e51-ae06-24500312482c => generated 1577 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:53:59.991380 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.virt.hardware [None req-2dc79562-dd95-455a-a2ba-8bdf5b29e0e3 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Flavor limits 0:0:0 {{(pid=124823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 12:53:59.991811 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.virt.hardware [None req-2dc79562-dd95-455a-a2ba-8bdf5b29e0e3 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Image limits 0:0:0 {{(pid=124823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 12:53:59.992289 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.virt.hardware [None req-2dc79562-dd95-455a-a2ba-8bdf5b29e0e3 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Flavor pref 0:0:0 {{(pid=124823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 12:53:59.992699 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.virt.hardware [None req-2dc79562-dd95-455a-a2ba-8bdf5b29e0e3 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Image pref 0:0:0 {{(pid=124823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 12:53:59.993112 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.virt.hardware [None req-2dc79562-dd95-455a-a2ba-8bdf5b29e0e3 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 12:54:00.003382 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-2dc79562-dd95-455a-a2ba-8bdf5b29e0e3 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:00.005262 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-2dc79562-dd95-455a-a2ba-8bdf5b29e0e3 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:00.005262 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-2dc79562-dd95-455a-a2ba-8bdf5b29e0e3 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:00.006035 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-2dc79562-dd95-455a-a2ba-8bdf5b29e0e3 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:00.026044 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.quota [None req-2dc79562-dd95-455a-a2ba-8bdf5b29e0e3 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Getting quotas for project cbe580a28eae4195be1491ac29d373a7. Resources: {'instances', 'ram', 'cores'} {{(pid=124823) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:54:00.030256 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.quota [None req-2dc79562-dd95-455a-a2ba-8bdf5b29e0e3 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Getting quotas for user aa52505a079041efbbf14fb04da7ac7f and project cbe580a28eae4195be1491ac29d373a7. Resources: {'instances', 'ram', 'cores'} {{(pid=124823) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:54:00.041758 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-2dc79562-dd95-455a-a2ba-8bdf5b29e0e3 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Going to run 1 instances... {{(pid=124823) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 12:54:00.043910 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-2dc79562-dd95-455a-a2ba-8bdf5b29e0e3 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] [instance: 7f3fde81-3f47-4590-ad2e-330bd31ed1f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6df25342-b071-489b-a7c1-3089fa19af6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124823) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 12:54:00.239253 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-2dc79562-dd95-455a-a2ba-8bdf5b29e0e3 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.802655 May 26 12:54:00.239925 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 396/787] 10.222.0.41 () {60 vars in 1146 bytes} [Thu May 26 12:53:59 2022] POST /compute/v2.1/servers => generated 402 bytes in 804 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 12:54:00.250520 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-62d91095-5d25-465c-8e63-aa8e4e8d991e tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:00.251137 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-62d91095-5d25-465c-8e63-aa8e4e8d991e tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] [instance: 7f3fde81-3f47-4590-ad2e-330bd31ed1f7] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:00.304115 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-62d91095-5d25-465c-8e63-aa8e4e8d991e tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa52505a079041efbbf14fb04da7ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe580a28eae4195be1491ac29d373a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:54:00.312185 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-62d91095-5d25-465c-8e63-aa8e4e8d991e tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] 10.222.0.41 "GET /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7" status: 200 len: 1238 microversion: 2.1 time: 0.066081 May 26 12:54:00.312989 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 392/788] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:54:00 2022] GET /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7 => generated 1238 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:54:00.960840 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-e8138713-bf01-44a9-811c-572fa440ea7c tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:00.961436 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-e8138713-bf01-44a9-811c-572fa440ea7c tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] [instance: 2b1f3f01-d549-4e51-ae06-24500312482c] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:00.970802 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-e8138713-bf01-44a9-811c-572fa440ea7c tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:00.971249 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-e8138713-bf01-44a9-811c-572fa440ea7c tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:00.972014 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-e8138713-bf01-44a9-811c-572fa440ea7c tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:00.972444 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-e8138713-bf01-44a9-811c-572fa440ea7c tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:01.064212 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-203ab544-480e-4421-a3d2-727fe42ba06d tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3a1babfd-7276-4da6-adcf-6cd805b82e2b"}} {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:54:01.065350 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-203ab544-480e-4421-a3d2-727fe42ba06d tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] [instance: d1efb756-8e30-4c05-9156-de4ae119ac3c] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:01.072190 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-203ab544-480e-4421-a3d2-727fe42ba06d tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:01.072886 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-203ab544-480e-4421-a3d2-727fe42ba06d tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:01.073677 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-203ab544-480e-4421-a3d2-727fe42ba06d tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:01.074120 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-203ab544-480e-4421-a3d2-727fe42ba06d tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:01.121318 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-e8138713-bf01-44a9-811c-572fa440ea7c tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47d51863b0448b880dc03b01dec6dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23568023763549669484e71430e34389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:54:01.131480 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-e8138713-bf01-44a9-811c-572fa440ea7c tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] 10.222.0.41 "GET /compute/v2.1/servers/2b1f3f01-d549-4e51-ae06-24500312482c" status: 200 len: 1577 microversion: 2.1 time: 0.175037 May 26 12:54:01.132054 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 397/789] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:54:00 2022] GET /compute/v2.1/servers/2b1f3f01-d549-4e51-ae06-24500312482c => generated 1577 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:54:01.330314 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-f66c7ad7-50f3-4ead-8aa9-ed92adf5bc8f tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:01.330930 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-f66c7ad7-50f3-4ead-8aa9-ed92adf5bc8f tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] [instance: 7f3fde81-3f47-4590-ad2e-330bd31ed1f7] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:01.384566 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-f66c7ad7-50f3-4ead-8aa9-ed92adf5bc8f tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa52505a079041efbbf14fb04da7ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe580a28eae4195be1491ac29d373a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:54:01.392369 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-f66c7ad7-50f3-4ead-8aa9-ed92adf5bc8f tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] 10.222.0.41 "GET /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7" status: 200 len: 1238 microversion: 2.1 time: 0.066489 May 26 12:54:01.393314 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 398/790] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:54:01 2022] GET /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7 => generated 1238 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:54:02.036547 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-203ab544-480e-4421-a3d2-727fe42ba06d tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] 10.222.0.41 "POST /compute/v2.1/servers/d1efb756-8e30-4c05-9156-de4ae119ac3c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.976508 May 26 12:54:02.037194 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 393/791] 10.222.0.41 () {60 vars in 1322 bytes} [Thu May 26 12:54:01 2022] POST /compute/v2.1/servers/d1efb756-8e30-4c05-9156-de4ae119ac3c/os-volume_attachments => generated 194 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:54:02.149610 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-12bdcf3c-f971-43d8-a480-a0bc68f32f2a tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:02.150260 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-12bdcf3c-f971-43d8-a480-a0bc68f32f2a tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] [instance: 2b1f3f01-d549-4e51-ae06-24500312482c] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:02.157988 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-12bdcf3c-f971-43d8-a480-a0bc68f32f2a tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:02.158439 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-12bdcf3c-f971-43d8-a480-a0bc68f32f2a tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:02.159206 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-12bdcf3c-f971-43d8-a480-a0bc68f32f2a tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:02.159643 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-12bdcf3c-f971-43d8-a480-a0bc68f32f2a tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:02.224886 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-12bdcf3c-f971-43d8-a480-a0bc68f32f2a tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47d51863b0448b880dc03b01dec6dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23568023763549669484e71430e34389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:54:02.238294 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-12bdcf3c-f971-43d8-a480-a0bc68f32f2a tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] 10.222.0.41 "GET /compute/v2.1/servers/2b1f3f01-d549-4e51-ae06-24500312482c" status: 200 len: 1510 microversion: 2.1 time: 0.092364 May 26 12:54:02.239734 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 399/792] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:54:02 2022] GET /compute/v2.1/servers/2b1f3f01-d549-4e51-ae06-24500312482c => generated 1510 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:54:02.268758 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [req-697b672e-2baf-4d05-b541-84c81f1a8750 req-0a43efa2-2bac-4178-a835-bb610468b26e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b1f3f01-d549-4e51-ae06-24500312482c", "name": "network-vif-deleted", "tag": "b5cef465-47cf-457a-a033-c7366a071c70"}]} {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:54:02.277145 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [req-697b672e-2baf-4d05-b541-84c81f1a8750 req-0a43efa2-2bac-4178-a835-bb610468b26e service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:02.277577 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [req-697b672e-2baf-4d05-b541-84c81f1a8750 req-0a43efa2-2bac-4178-a835-bb610468b26e service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:02.289759 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.compute.server_external_events [req-697b672e-2baf-4d05-b541-84c81f1a8750 req-0a43efa2-2bac-4178-a835-bb610468b26e service nova] Creating event network-vif-deleted:b5cef465-47cf-457a-a033-c7366a071c70 for instance 2b1f3f01-d549-4e51-ae06-24500312482c on hv-cinder-81571 May 26 12:54:02.295378 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [req-697b672e-2baf-4d05-b541-84c81f1a8750 req-0a43efa2-2bac-4178-a835-bb610468b26e service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030184 May 26 12:54:02.297540 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 394/793] 10.222.0.41 () {64 vars in 1317 bytes} [Thu May 26 12:54:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:54:02.409844 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-c49448b1-00a8-470a-a4e0-abcde08645a0 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:02.411005 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-c49448b1-00a8-470a-a4e0-abcde08645a0 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] [instance: 7f3fde81-3f47-4590-ad2e-330bd31ed1f7] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:02.418195 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-c49448b1-00a8-470a-a4e0-abcde08645a0 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:02.418708 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-c49448b1-00a8-470a-a4e0-abcde08645a0 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:02.419730 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-c49448b1-00a8-470a-a4e0-abcde08645a0 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:02.420813 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-c49448b1-00a8-470a-a4e0-abcde08645a0 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:02.486043 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-c49448b1-00a8-470a-a4e0-abcde08645a0 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa52505a079041efbbf14fb04da7ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe580a28eae4195be1491ac29d373a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:54:02.493305 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-c49448b1-00a8-470a-a4e0-abcde08645a0 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] 10.222.0.41 "GET /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7" status: 200 len: 1242 microversion: 2.1 time: 0.087435 May 26 12:54:02.493890 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 400/794] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:54:02 2022] GET /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7 => generated 1242 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:54:03.256999 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-355f56d5-9018-46b9-a9ae-7605599bdc87 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:03.257733 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-355f56d5-9018-46b9-a9ae-7605599bdc87 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] [instance: 2b1f3f01-d549-4e51-ae06-24500312482c] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:03.264705 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-355f56d5-9018-46b9-a9ae-7605599bdc87 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:03.265142 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-355f56d5-9018-46b9-a9ae-7605599bdc87 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:03.265962 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-355f56d5-9018-46b9-a9ae-7605599bdc87 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:03.266392 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-355f56d5-9018-46b9-a9ae-7605599bdc87 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:03.338217 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-355f56d5-9018-46b9-a9ae-7605599bdc87 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47d51863b0448b880dc03b01dec6dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23568023763549669484e71430e34389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:54:03.347217 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-355f56d5-9018-46b9-a9ae-7605599bdc87 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] 10.222.0.41 "GET /compute/v2.1/servers/2b1f3f01-d549-4e51-ae06-24500312482c" status: 200 len: 1510 microversion: 2.1 time: 0.094844 May 26 12:54:03.347811 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 395/795] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:54:03 2022] GET /compute/v2.1/servers/2b1f3f01-d549-4e51-ae06-24500312482c => generated 1510 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:54:03.514370 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-f29f2ece-91f0-4d81-9d7d-48037dc60a57 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:03.515411 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-f29f2ece-91f0-4d81-9d7d-48037dc60a57 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] [instance: 7f3fde81-3f47-4590-ad2e-330bd31ed1f7] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:03.522440 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-f29f2ece-91f0-4d81-9d7d-48037dc60a57 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:03.528884 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-f29f2ece-91f0-4d81-9d7d-48037dc60a57 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:03.528884 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-f29f2ece-91f0-4d81-9d7d-48037dc60a57 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:03.528884 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-f29f2ece-91f0-4d81-9d7d-48037dc60a57 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:03.586413 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-f29f2ece-91f0-4d81-9d7d-48037dc60a57 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa52505a079041efbbf14fb04da7ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe580a28eae4195be1491ac29d373a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:54:03.594391 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-f29f2ece-91f0-4d81-9d7d-48037dc60a57 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] 10.222.0.41 "GET /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7" status: 200 len: 1242 microversion: 2.1 time: 0.086958 May 26 12:54:03.594946 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 401/796] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:54:03 2022] GET /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7 => generated 1242 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:54:04.364980 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-289d9ed3-65f7-406e-9e27-5874580b5434 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:04.365599 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-289d9ed3-65f7-406e-9e27-5874580b5434 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] [instance: 2b1f3f01-d549-4e51-ae06-24500312482c] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:04.372423 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-289d9ed3-65f7-406e-9e27-5874580b5434 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:04.372877 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-289d9ed3-65f7-406e-9e27-5874580b5434 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:04.373644 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-289d9ed3-65f7-406e-9e27-5874580b5434 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:04.374113 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-289d9ed3-65f7-406e-9e27-5874580b5434 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:04.596898 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-289d9ed3-65f7-406e-9e27-5874580b5434 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47d51863b0448b880dc03b01dec6dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23568023763549669484e71430e34389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:54:04.604715 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-289d9ed3-65f7-406e-9e27-5874580b5434 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] 10.222.0.41 "GET /compute/v2.1/servers/2b1f3f01-d549-4e51-ae06-24500312482c" status: 200 len: 1226 microversion: 2.1 time: 0.243325 May 26 12:54:04.604925 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 396/797] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:54:04 2022] GET /compute/v2.1/servers/2b1f3f01-d549-4e51-ae06-24500312482c => generated 1226 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:54:04.614698 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-56e834c3-d9dd-4e92-9380-05529f2eadee tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:04.617994 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-56e834c3-d9dd-4e92-9380-05529f2eadee tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] [instance: 7f3fde81-3f47-4590-ad2e-330bd31ed1f7] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:04.623386 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-56e834c3-d9dd-4e92-9380-05529f2eadee tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:04.623815 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-56e834c3-d9dd-4e92-9380-05529f2eadee tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:04.624602 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-56e834c3-d9dd-4e92-9380-05529f2eadee tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:04.625068 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-56e834c3-d9dd-4e92-9380-05529f2eadee tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:04.704681 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-56e834c3-d9dd-4e92-9380-05529f2eadee tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa52505a079041efbbf14fb04da7ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe580a28eae4195be1491ac29d373a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:54:04.712107 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-56e834c3-d9dd-4e92-9380-05529f2eadee tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] 10.222.0.41 "GET /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7" status: 200 len: 1290 microversion: 2.1 time: 0.103927 May 26 12:54:04.712673 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 402/798] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:54:04 2022] GET /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7 => generated 1290 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:54:05.621683 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-b3d5692d-a7b3-4c34-bd9f-758632b366d0 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:05.622624 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-b3d5692d-a7b3-4c34-bd9f-758632b366d0 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] [instance: 2b1f3f01-d549-4e51-ae06-24500312482c] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:05.631998 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-b3d5692d-a7b3-4c34-bd9f-758632b366d0 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:05.639698 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-b3d5692d-a7b3-4c34-bd9f-758632b366d0 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:05.639698 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-b3d5692d-a7b3-4c34-bd9f-758632b366d0 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:05.639698 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-b3d5692d-a7b3-4c34-bd9f-758632b366d0 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:05.639698 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG dbcounter [-] [124824] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:54:05.647488 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.wsgi [None req-b3d5692d-a7b3-4c34-bd9f-758632b366d0 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] HTTP exception thrown: Instance 2b1f3f01-d549-4e51-ae06-24500312482c could not be found. May 26 12:54:05.649165 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-b3d5692d-a7b3-4c34-bd9f-758632b366d0 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Request method failure captured: May 26 12:54:05.649165 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: request: GET /compute/v2.1/servers/2b1f3f01-d549-4e51-ae06-24500312482c HTTP/1.1 May 26 12:54:05.649165 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Accept: application/json May 26 12:54:05.649165 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Accept-Encoding: identity May 26 12:54:05.649165 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Connection: close May 26 12:54:05.649165 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Content-Length: 0 May 26 12:54:05.649165 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Content-Type: application/json May 26 12:54:05.649165 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Host: 10.222.0.41 May 26 12:54:05.649165 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Openstack-System-Scope: None May 26 12:54:05.649165 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: User-Agent: python-urllib3/1.26.9 May 26 12:54:05.649165 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Auth-Token: gAAAAABij3ex2rFQ9UlBXFi2IjYGXp-kvvCAfc50TLy59CDxGhP1PTEuOfA2BJ0_RUfoFDTNs98Le9vda0LdfrJuZMS_aSN6bLCCFV-QhSBlSdomQU4bOs98p0gOa5IZdVXyQcqQbgwz8rl9id91HXdLeRvyznNbALhgY6xV6IqlhG0RBsHuSss May 26 12:54:05.649165 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Domain-Id: None May 26 12:54:05.649165 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Domain-Name: None May 26 12:54:05.649165 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Identity-Status: Confirmed May 26 12:54:05.649165 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Is-Admin-Project: True May 26 12:54:05.649165 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Domain-Id: default May 26 12:54:05.649165 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Domain-Name: Default May 26 12:54:05.649165 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Id: 23568023763549669484e71430e34389 May 26 12:54:05.649165 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Name: tempest-TestVolumeBootPattern-1570249511 May 26 12:54:05.649165 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Role: member,reader May 26 12:54:05.649165 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Roles: member,reader May 26 12:54:05.650650 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/23568023763549669484e71430e34389"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/23568023763549669484e71430e34389"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/23568023763549669484e71430e34389"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_23568023763549669484e71430e34389", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 26 12:54:05.650650 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Tenant: tempest-TestVolumeBootPattern-1570249511 May 26 12:54:05.650650 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Tenant-Id: 23568023763549669484e71430e34389 May 26 12:54:05.650650 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Tenant-Name: tempest-TestVolumeBootPattern-1570249511 May 26 12:54:05.650650 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User: tempest-TestVolumeBootPattern-1570249511-project May 26 12:54:05.650650 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Domain-Id: default May 26 12:54:05.650650 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Domain-Name: Default May 26 12:54:05.650650 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Id: b47d51863b0448b880dc03b01dec6dc5 May 26 12:54:05.650650 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Name: tempest-TestVolumeBootPattern-1570249511-project May 26 12:54:05.650650 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: method: > May 26 12:54:05.650650 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: exception: Instance 2b1f3f01-d549-4e51-ae06-24500312482c could not be found. May 26 12:54:05.650650 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: action_args: {'id': '2b1f3f01-d549-4e51-ae06-24500312482c'} May 26 12:54:05.651513 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:54:05.651513 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:54:05.651513 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:54:05.651513 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:54:05.651513 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:54:05.651513 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:54:05.651513 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:54:05.651513 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:54:05.651513 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:54:05.651513 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:54:05.651513 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b1f3f01-d549-4e51-ae06-24500312482c could not be found. May 26 12:54:05.651513 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:54:05.651513 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:54:05.651513 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:54:05.651513 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:54:05.651513 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:54:05.651513 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:54:05.651513 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:54:05.651513 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:54:05.651513 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:54:05.652771 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:54:05.652771 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 12:54:05.652771 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 12:54:05.652771 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:54:05.652771 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:54:05.652771 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:54:05.652771 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:54:05.652771 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b1f3f01-d549-4e51-ae06-24500312482c could not be found. May 26 12:54:05.652771 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:54:05.652771 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:54:05.652771 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:54:05.652771 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:54:05.652771 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:54:05.652771 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:54:05.652771 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:54:05.652771 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:54:05.652771 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b1f3f01-d549-4e51-ae06-24500312482c could not be found. May 26 12:54:05.652771 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:54:05.655331 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-b3d5692d-a7b3-4c34-bd9f-758632b366d0 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Returning 404 to user: Instance 2b1f3f01-d549-4e51-ae06-24500312482c could not be found. {{(pid=124824) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:54:05.656293 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-b3d5692d-a7b3-4c34-bd9f-758632b366d0 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] 10.222.0.41 "GET /compute/v2.1/servers/2b1f3f01-d549-4e51-ae06-24500312482c" status: 404 len: 111 microversion: 2.1 time: 0.038703 May 26 12:54:05.656917 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 397/799] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:54:05 2022] GET /compute/v2.1/servers/2b1f3f01-d549-4e51-ae06-24500312482c => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:54:05.730572 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-b92f569a-4b95-40cc-b597-a2c13297ccc7 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:05.731211 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-b92f569a-4b95-40cc-b597-a2c13297ccc7 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] [instance: 7f3fde81-3f47-4590-ad2e-330bd31ed1f7] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:05.738270 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-b92f569a-4b95-40cc-b597-a2c13297ccc7 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:05.738956 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-b92f569a-4b95-40cc-b597-a2c13297ccc7 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:05.739902 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-b92f569a-4b95-40cc-b597-a2c13297ccc7 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:05.740497 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-b92f569a-4b95-40cc-b597-a2c13297ccc7 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:05.774101 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-b95a5fb4-651d-442a-9722-6cdbd4e38df4 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-108499166", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1054937962", "security_groups": [{"name": "tempest-secgroup-smoke-178378433"}], "block_device_mapping_v2": [{"uuid": "208a5ab8-4087-4ecb-8fc0-dc28ebd669ba", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "597bf63d-63f6-4d8e-ac74-b0e435929cf3"}]}} {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:54:06.006753 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.network.neutron [None req-b95a5fb4-651d-442a-9722-6cdbd4e38df4 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] validate_networks() for [('597bf63d-63f6-4d8e-ac74-b0e435929cf3', None, None, None, None, None)] {{(pid=124824) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 12:54:06.261140 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-b92f569a-4b95-40cc-b597-a2c13297ccc7 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa52505a079041efbbf14fb04da7ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe580a28eae4195be1491ac29d373a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:54:06.271042 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-b92f569a-4b95-40cc-b597-a2c13297ccc7 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] 10.222.0.41 "GET /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7" status: 200 len: 1364 microversion: 2.1 time: 0.544209 May 26 12:54:06.273419 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 403/800] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:54:05 2022] GET /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7 => generated 1364 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:54:06.751519 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.virt.hardware [None req-b95a5fb4-651d-442a-9722-6cdbd4e38df4 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Flavor limits 0:0:0 {{(pid=124824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 12:54:06.751969 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.virt.hardware [None req-b95a5fb4-651d-442a-9722-6cdbd4e38df4 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Image limits 0:0:0 {{(pid=124824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 12:54:06.752463 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.virt.hardware [None req-b95a5fb4-651d-442a-9722-6cdbd4e38df4 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Flavor pref 0:0:0 {{(pid=124824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 12:54:06.752868 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.virt.hardware [None req-b95a5fb4-651d-442a-9722-6cdbd4e38df4 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Image pref 0:0:0 {{(pid=124824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 12:54:06.753276 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.virt.hardware [None req-b95a5fb4-651d-442a-9722-6cdbd4e38df4 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 12:54:06.762640 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-b95a5fb4-651d-442a-9722-6cdbd4e38df4 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:06.763081 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-b95a5fb4-651d-442a-9722-6cdbd4e38df4 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:06.763863 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-b95a5fb4-651d-442a-9722-6cdbd4e38df4 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:06.764298 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-b95a5fb4-651d-442a-9722-6cdbd4e38df4 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:06.781085 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.quota [None req-b95a5fb4-651d-442a-9722-6cdbd4e38df4 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Getting quotas for project 23568023763549669484e71430e34389. Resources: {'instances', 'ram', 'cores'} {{(pid=124824) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:54:06.784994 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.quota [None req-b95a5fb4-651d-442a-9722-6cdbd4e38df4 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Getting quotas for user b47d51863b0448b880dc03b01dec6dc5 and project 23568023763549669484e71430e34389. Resources: {'instances', 'ram', 'cores'} {{(pid=124824) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:54:06.844350 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-b95a5fb4-651d-442a-9722-6cdbd4e38df4 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Going to run 1 instances... {{(pid=124824) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 12:54:06.846733 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-b95a5fb4-651d-442a-9722-6cdbd4e38df4 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] [instance: f24cf723-09f4-49a6-8e36-13cccb384169] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='208a5ab8-4087-4ecb-8fc0-dc28ebd669ba',volume_size=None,volume_type=None)] {{(pid=124824) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 12:54:07.277226 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [req-8df95806-5963-41e6-b43e-7cdcc0377bc4 req-63bac684-8b2f-4774-8879-d55c5c6cdac4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f3fde81-3f47-4590-ad2e-330bd31ed1f7", "tag": "24bce984-312f-419b-85cf-8dba81242975"}]} {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:54:07.292796 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [req-8df95806-5963-41e6-b43e-7cdcc0377bc4 req-63bac684-8b2f-4774-8879-d55c5c6cdac4 service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:07.305864 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [req-8df95806-5963-41e6-b43e-7cdcc0377bc4 req-63bac684-8b2f-4774-8879-d55c5c6cdac4 service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:07.305864 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.compute.server_external_events [req-8df95806-5963-41e6-b43e-7cdcc0377bc4 req-63bac684-8b2f-4774-8879-d55c5c6cdac4 service nova] Creating event network-changed:24bce984-312f-419b-85cf-8dba81242975 for instance 7f3fde81-3f47-4590-ad2e-330bd31ed1f7 on hv-cinder-81571 May 26 12:54:07.310897 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [req-8df95806-5963-41e6-b43e-7cdcc0377bc4 req-63bac684-8b2f-4774-8879-d55c5c6cdac4 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038996 May 26 12:54:07.313311 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 404/801] 10.222.0.41 () {64 vars in 1317 bytes} [Thu May 26 12:54:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:54:07.331389 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-4ac2fb37-5e1b-408f-874e-e477253b0062 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:07.331389 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-4ac2fb37-5e1b-408f-874e-e477253b0062 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] [instance: 7f3fde81-3f47-4590-ad2e-330bd31ed1f7] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:07.338310 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-4ac2fb37-5e1b-408f-874e-e477253b0062 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:07.338770 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-4ac2fb37-5e1b-408f-874e-e477253b0062 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:07.339561 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-4ac2fb37-5e1b-408f-874e-e477253b0062 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:07.340003 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-4ac2fb37-5e1b-408f-874e-e477253b0062 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:07.481178 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-b95a5fb4-651d-442a-9722-6cdbd4e38df4 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.706925 May 26 12:54:07.483187 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 398/802] 10.222.0.41 () {60 vars in 1146 bytes} [Thu May 26 12:54:05 2022] POST /compute/v2.1/servers => generated 405 bytes in 1714 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 12:54:07.492867 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-6c836449-7587-4445-af86-9f64ccdd4607 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:07.497451 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-6c836449-7587-4445-af86-9f64ccdd4607 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] [instance: f24cf723-09f4-49a6-8e36-13cccb384169] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:07.554723 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-4ac2fb37-5e1b-408f-874e-e477253b0062 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa52505a079041efbbf14fb04da7ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe580a28eae4195be1491ac29d373a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:54:07.568792 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-4ac2fb37-5e1b-408f-874e-e477253b0062 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] 10.222.0.41 "GET /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7" status: 200 len: 1364 microversion: 2.1 time: 0.253692 May 26 12:54:07.575469 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 405/803] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:54:07 2022] GET /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7 => generated 1364 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:54:07.674234 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-6c836449-7587-4445-af86-9f64ccdd4607 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47d51863b0448b880dc03b01dec6dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23568023763549669484e71430e34389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:54:07.684043 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-6c836449-7587-4445-af86-9f64ccdd4607 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] 10.222.0.41 "GET /compute/v2.1/servers/f24cf723-09f4-49a6-8e36-13cccb384169" status: 200 len: 1094 microversion: 2.1 time: 0.195777 May 26 12:54:07.687090 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 399/804] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:54:07 2022] GET /compute/v2.1/servers/f24cf723-09f4-49a6-8e36-13cccb384169 => generated 1094 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:54:08.586659 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-4c685f35-6733-45c6-858f-b13bca5cc37b tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:08.587781 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-4c685f35-6733-45c6-858f-b13bca5cc37b tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] [instance: 7f3fde81-3f47-4590-ad2e-330bd31ed1f7] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:08.595487 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-4c685f35-6733-45c6-858f-b13bca5cc37b tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:08.595932 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-4c685f35-6733-45c6-858f-b13bca5cc37b tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:08.596686 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-4c685f35-6733-45c6-858f-b13bca5cc37b tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:08.597116 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-4c685f35-6733-45c6-858f-b13bca5cc37b tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:08.700927 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-2f90bcc0-4117-4756-a8ba-7f96a03caeac tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:08.701567 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-2f90bcc0-4117-4756-a8ba-7f96a03caeac tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] [instance: f24cf723-09f4-49a6-8e36-13cccb384169] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:08.708850 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-2f90bcc0-4117-4756-a8ba-7f96a03caeac tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:08.709237 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-2f90bcc0-4117-4756-a8ba-7f96a03caeac tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:08.710171 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-2f90bcc0-4117-4756-a8ba-7f96a03caeac tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:08.710606 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-2f90bcc0-4117-4756-a8ba-7f96a03caeac tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:08.727535 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-4c685f35-6733-45c6-858f-b13bca5cc37b tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa52505a079041efbbf14fb04da7ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe580a28eae4195be1491ac29d373a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:54:08.735632 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-4c685f35-6733-45c6-858f-b13bca5cc37b tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] 10.222.0.41 "GET /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7" status: 200 len: 1364 microversion: 2.1 time: 0.153311 May 26 12:54:08.736592 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 406/805] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:54:08 2022] GET /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:54:08.772056 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-2f90bcc0-4117-4756-a8ba-7f96a03caeac tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47d51863b0448b880dc03b01dec6dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23568023763549669484e71430e34389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:54:08.779453 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-2f90bcc0-4117-4756-a8ba-7f96a03caeac tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] 10.222.0.41 "GET /compute/v2.1/servers/f24cf723-09f4-49a6-8e36-13cccb384169" status: 200 len: 1144 microversion: 2.1 time: 0.082477 May 26 12:54:08.780021 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 400/806] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:54:08 2022] GET /compute/v2.1/servers/f24cf723-09f4-49a6-8e36-13cccb384169 => generated 1144 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:54:09.752722 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-22b1c7f6-3f12-4b29-b846-b879dd55c480 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:09.753335 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-22b1c7f6-3f12-4b29-b846-b879dd55c480 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] [instance: 7f3fde81-3f47-4590-ad2e-330bd31ed1f7] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:09.760375 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-22b1c7f6-3f12-4b29-b846-b879dd55c480 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:09.764294 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-22b1c7f6-3f12-4b29-b846-b879dd55c480 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:09.764294 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-22b1c7f6-3f12-4b29-b846-b879dd55c480 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:09.764294 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-22b1c7f6-3f12-4b29-b846-b879dd55c480 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:09.802182 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-1b38267f-2a2e-4b86-8cff-386c1f0b10f6 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:09.802852 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-1b38267f-2a2e-4b86-8cff-386c1f0b10f6 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] [instance: f24cf723-09f4-49a6-8e36-13cccb384169] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:09.815726 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-1b38267f-2a2e-4b86-8cff-386c1f0b10f6 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:09.816168 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-1b38267f-2a2e-4b86-8cff-386c1f0b10f6 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:09.816936 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-1b38267f-2a2e-4b86-8cff-386c1f0b10f6 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:09.817368 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-1b38267f-2a2e-4b86-8cff-386c1f0b10f6 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:09.889329 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-1b38267f-2a2e-4b86-8cff-386c1f0b10f6 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47d51863b0448b880dc03b01dec6dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23568023763549669484e71430e34389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:54:09.899539 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-1b38267f-2a2e-4b86-8cff-386c1f0b10f6 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] 10.222.0.41 "GET /compute/v2.1/servers/f24cf723-09f4-49a6-8e36-13cccb384169" status: 200 len: 1136 microversion: 2.1 time: 0.106922 May 26 12:54:09.909977 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 401/807] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:54:09 2022] GET /compute/v2.1/servers/f24cf723-09f4-49a6-8e36-13cccb384169 => generated 1136 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:54:09.929243 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-22b1c7f6-3f12-4b29-b846-b879dd55c480 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa52505a079041efbbf14fb04da7ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe580a28eae4195be1491ac29d373a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:54:09.929732 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG dbcounter [-] [124823] Writing DB stats nova_cell1:SELECT=100 {{(pid=124823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:54:09.942065 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-22b1c7f6-3f12-4b29-b846-b879dd55c480 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] 10.222.0.41 "GET /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7" status: 200 len: 1364 microversion: 2.1 time: 0.193598 May 26 12:54:09.942681 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 407/808] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:54:09 2022] GET /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7 => generated 1364 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:54:10.916990 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-ff7279af-224e-46dd-93cb-6d7ae974e1b7 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:10.917946 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-ff7279af-224e-46dd-93cb-6d7ae974e1b7 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] [instance: f24cf723-09f4-49a6-8e36-13cccb384169] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:10.925443 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-ff7279af-224e-46dd-93cb-6d7ae974e1b7 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:10.925933 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-ff7279af-224e-46dd-93cb-6d7ae974e1b7 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:10.926706 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-ff7279af-224e-46dd-93cb-6d7ae974e1b7 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:10.927146 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-ff7279af-224e-46dd-93cb-6d7ae974e1b7 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:10.959599 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-ab468b9d-99fb-46e9-b2df-3580826982dd tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:10.960851 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-ab468b9d-99fb-46e9-b2df-3580826982dd tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] [instance: 7f3fde81-3f47-4590-ad2e-330bd31ed1f7] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:10.963923 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG dbcounter [-] [124823] Writing DB stats nova_cell0:SELECT=2 {{(pid=124823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:54:10.971599 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-ab468b9d-99fb-46e9-b2df-3580826982dd tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:10.971599 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-ab468b9d-99fb-46e9-b2df-3580826982dd tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:10.972531 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-ab468b9d-99fb-46e9-b2df-3580826982dd tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:10.973127 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-ab468b9d-99fb-46e9-b2df-3580826982dd tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:10.994112 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-ff7279af-224e-46dd-93cb-6d7ae974e1b7 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47d51863b0448b880dc03b01dec6dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23568023763549669484e71430e34389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:54:11.002142 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-ff7279af-224e-46dd-93cb-6d7ae974e1b7 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] 10.222.0.41 "GET /compute/v2.1/servers/f24cf723-09f4-49a6-8e36-13cccb384169" status: 200 len: 1192 microversion: 2.1 time: 0.089527 May 26 12:54:11.002923 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 402/809] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:54:10 2022] GET /compute/v2.1/servers/f24cf723-09f4-49a6-8e36-13cccb384169 => generated 1192 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:54:11.108826 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-ab468b9d-99fb-46e9-b2df-3580826982dd tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa52505a079041efbbf14fb04da7ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe580a28eae4195be1491ac29d373a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:54:11.116176 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-ab468b9d-99fb-46e9-b2df-3580826982dd tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] 10.222.0.41 "GET /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7" status: 200 len: 1364 microversion: 2.1 time: 0.160854 May 26 12:54:11.116915 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 408/810] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:54:10 2022] GET /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7 => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:54:12.018804 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-e5b5e1f5-b117-45ba-912d-8b8f327316b8 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:12.019420 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-e5b5e1f5-b117-45ba-912d-8b8f327316b8 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] [instance: f24cf723-09f4-49a6-8e36-13cccb384169] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:12.026045 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-e5b5e1f5-b117-45ba-912d-8b8f327316b8 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:12.026499 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-e5b5e1f5-b117-45ba-912d-8b8f327316b8 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:12.028712 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-e5b5e1f5-b117-45ba-912d-8b8f327316b8 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:12.028712 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-e5b5e1f5-b117-45ba-912d-8b8f327316b8 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:12.137600 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG dbcounter [-] [124823] Writing DB stats nova_cell0:SELECT=8 {{(pid=124823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:54:12.143370 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-2e805035-d31a-428e-a056-7308f41e1217 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:12.143987 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-2e805035-d31a-428e-a056-7308f41e1217 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] [instance: 7f3fde81-3f47-4590-ad2e-330bd31ed1f7] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:12.162594 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-2e805035-d31a-428e-a056-7308f41e1217 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:12.163044 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-2e805035-d31a-428e-a056-7308f41e1217 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:12.163994 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-2e805035-d31a-428e-a056-7308f41e1217 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:12.164771 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-2e805035-d31a-428e-a056-7308f41e1217 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:12.252159 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-e5b5e1f5-b117-45ba-912d-8b8f327316b8 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47d51863b0448b880dc03b01dec6dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23568023763549669484e71430e34389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:54:12.264131 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-e5b5e1f5-b117-45ba-912d-8b8f327316b8 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] 10.222.0.41 "GET /compute/v2.1/servers/f24cf723-09f4-49a6-8e36-13cccb384169" status: 200 len: 1210 microversion: 2.1 time: 0.248984 May 26 12:54:12.265759 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 403/811] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:54:12 2022] GET /compute/v2.1/servers/f24cf723-09f4-49a6-8e36-13cccb384169 => generated 1210 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:54:12.271425 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [req-3afd3407-26d3-413d-ba12-897f3a2876b1 req-2c1daab9-2650-4665-a72f-1459169fb140 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f3fde81-3f47-4590-ad2e-330bd31ed1f7", "name": "network-vif-plugged", "status": "completed", "tag": "24bce984-312f-419b-85cf-8dba81242975"}]} {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:54:12.285027 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [req-3afd3407-26d3-413d-ba12-897f3a2876b1 req-2c1daab9-2650-4665-a72f-1459169fb140 service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:12.285731 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [req-3afd3407-26d3-413d-ba12-897f3a2876b1 req-2c1daab9-2650-4665-a72f-1459169fb140 service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:12.302228 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.compute.server_external_events [req-3afd3407-26d3-413d-ba12-897f3a2876b1 req-2c1daab9-2650-4665-a72f-1459169fb140 service nova] Creating event network-vif-plugged:24bce984-312f-419b-85cf-8dba81242975 for instance 7f3fde81-3f47-4590-ad2e-330bd31ed1f7 on hv-cinder-81571 May 26 12:54:12.308366 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [req-3afd3407-26d3-413d-ba12-897f3a2876b1 req-2c1daab9-2650-4665-a72f-1459169fb140 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041181 May 26 12:54:12.310149 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 404/812] 10.222.0.41 () {64 vars in 1317 bytes} [Thu May 26 12:54:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:54:12.318996 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-ed905e05-115a-4eb3-bce5-b51ff555ed95 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:12.319908 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-ed905e05-115a-4eb3-bce5-b51ff555ed95 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] [instance: d1efb756-8e30-4c05-9156-de4ae119ac3c] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:12.330853 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-ed905e05-115a-4eb3-bce5-b51ff555ed95 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:12.331325 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-ed905e05-115a-4eb3-bce5-b51ff555ed95 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:12.332107 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-ed905e05-115a-4eb3-bce5-b51ff555ed95 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:12.332546 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-ed905e05-115a-4eb3-bce5-b51ff555ed95 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:12.379411 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-2e805035-d31a-428e-a056-7308f41e1217 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa52505a079041efbbf14fb04da7ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe580a28eae4195be1491ac29d373a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:54:12.387715 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-2e805035-d31a-428e-a056-7308f41e1217 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] 10.222.0.41 "GET /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7" status: 200 len: 1364 microversion: 2.1 time: 0.252214 May 26 12:54:12.398319 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 409/813] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:54:12 2022] GET /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7 => generated 1364 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:54:12.563731 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-ed905e05-115a-4eb3-bce5-b51ff555ed95 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7277aedb35df448e8b3056f8bc395e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c876091609fe45ba80370a16748cbeb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:54:12.575481 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-ed905e05-115a-4eb3-bce5-b51ff555ed95 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] 10.222.0.41 "GET /compute/v2.1/servers/d1efb756-8e30-4c05-9156-de4ae119ac3c" status: 200 len: 1596 microversion: 2.1 time: 0.263835 May 26 12:54:12.576501 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 405/814] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:54:12 2022] GET /compute/v2.1/servers/d1efb756-8e30-4c05-9156-de4ae119ac3c => generated 1596 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:54:13.285447 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-93e09c50-9c7e-438e-accd-0f5b9cb1cdc5 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:13.293035 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-93e09c50-9c7e-438e-accd-0f5b9cb1cdc5 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] [instance: f24cf723-09f4-49a6-8e36-13cccb384169] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:13.306290 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-93e09c50-9c7e-438e-accd-0f5b9cb1cdc5 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:13.306738 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-93e09c50-9c7e-438e-accd-0f5b9cb1cdc5 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:13.308206 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-93e09c50-9c7e-438e-accd-0f5b9cb1cdc5 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:13.308649 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-93e09c50-9c7e-438e-accd-0f5b9cb1cdc5 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:13.406608 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-faef0dfe-ab1d-4a1f-87c2-301a902b3aff tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:13.407222 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-faef0dfe-ab1d-4a1f-87c2-301a902b3aff tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] [instance: 7f3fde81-3f47-4590-ad2e-330bd31ed1f7] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:13.418097 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-faef0dfe-ab1d-4a1f-87c2-301a902b3aff tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:13.418550 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-faef0dfe-ab1d-4a1f-87c2-301a902b3aff tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:13.420775 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-faef0dfe-ab1d-4a1f-87c2-301a902b3aff tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:13.425531 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-faef0dfe-ab1d-4a1f-87c2-301a902b3aff tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:13.599905 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-faef0dfe-ab1d-4a1f-87c2-301a902b3aff tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa52505a079041efbbf14fb04da7ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe580a28eae4195be1491ac29d373a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:54:13.613506 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-93e09c50-9c7e-438e-accd-0f5b9cb1cdc5 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47d51863b0448b880dc03b01dec6dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23568023763549669484e71430e34389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:54:13.622768 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-93e09c50-9c7e-438e-accd-0f5b9cb1cdc5 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] 10.222.0.41 "GET /compute/v2.1/servers/f24cf723-09f4-49a6-8e36-13cccb384169" status: 200 len: 1265 microversion: 2.1 time: 0.341855 May 26 12:54:13.622960 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-faef0dfe-ab1d-4a1f-87c2-301a902b3aff tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] 10.222.0.41 "GET /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7" status: 200 len: 1364 microversion: 2.1 time: 0.220672 May 26 12:54:13.623692 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 406/815] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:54:13 2022] GET /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7 => generated 1364 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:54:13.623990 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 410/816] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:54:13 2022] GET /compute/v2.1/servers/f24cf723-09f4-49a6-8e36-13cccb384169 => generated 1265 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:54:13.715151 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [req-a9c48478-b765-4f15-93ad-17c7b29de021 req-1b15fc02-5b51-4c8e-9c9c-cfdad9f5c8de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f24cf723-09f4-49a6-8e36-13cccb384169", "tag": "d96fa6eb-c6ec-48b5-a0bf-bec9d462a6d5"}]} {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:54:13.735890 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [req-a9c48478-b765-4f15-93ad-17c7b29de021 req-1b15fc02-5b51-4c8e-9c9c-cfdad9f5c8de service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:13.735890 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [req-a9c48478-b765-4f15-93ad-17c7b29de021 req-1b15fc02-5b51-4c8e-9c9c-cfdad9f5c8de service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:13.747279 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.compute.server_external_events [req-a9c48478-b765-4f15-93ad-17c7b29de021 req-1b15fc02-5b51-4c8e-9c9c-cfdad9f5c8de service nova] Creating event network-changed:d96fa6eb-c6ec-48b5-a0bf-bec9d462a6d5 for instance f24cf723-09f4-49a6-8e36-13cccb384169 on hv-cinder-81571 May 26 12:54:13.753124 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [req-a9c48478-b765-4f15-93ad-17c7b29de021 req-1b15fc02-5b51-4c8e-9c9c-cfdad9f5c8de service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041835 May 26 12:54:13.754176 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 407/817] 10.222.0.41 () {64 vars in 1317 bytes} [Thu May 26 12:54:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:54:14.648751 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-4637ad5b-250e-43fa-9004-0f600a13069f tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:14.650219 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-6b75aeb2-2c64-423e-a0c9-b35ba13ed841 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:14.650927 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-6b75aeb2-2c64-423e-a0c9-b35ba13ed841 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] [instance: f24cf723-09f4-49a6-8e36-13cccb384169] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:14.652853 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-4637ad5b-250e-43fa-9004-0f600a13069f tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] [instance: 7f3fde81-3f47-4590-ad2e-330bd31ed1f7] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:14.663644 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-4637ad5b-250e-43fa-9004-0f600a13069f tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:14.664355 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-4637ad5b-250e-43fa-9004-0f600a13069f tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:14.665596 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-4637ad5b-250e-43fa-9004-0f600a13069f tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:14.666226 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-4637ad5b-250e-43fa-9004-0f600a13069f tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:14.666982 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-6b75aeb2-2c64-423e-a0c9-b35ba13ed841 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:14.668112 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-6b75aeb2-2c64-423e-a0c9-b35ba13ed841 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:14.668917 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-6b75aeb2-2c64-423e-a0c9-b35ba13ed841 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:14.669365 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-6b75aeb2-2c64-423e-a0c9-b35ba13ed841 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:14.928438 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-6b75aeb2-2c64-423e-a0c9-b35ba13ed841 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47d51863b0448b880dc03b01dec6dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23568023763549669484e71430e34389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:54:14.930649 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-4637ad5b-250e-43fa-9004-0f600a13069f tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa52505a079041efbbf14fb04da7ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe580a28eae4195be1491ac29d373a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:54:14.943457 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-4637ad5b-250e-43fa-9004-0f600a13069f tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] 10.222.0.41 "GET /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7" status: 200 len: 1549 microversion: 2.1 time: 0.302630 May 26 12:54:14.950353 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-6b75aeb2-2c64-423e-a0c9-b35ba13ed841 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] 10.222.0.41 "GET /compute/v2.1/servers/f24cf723-09f4-49a6-8e36-13cccb384169" status: 200 len: 1265 microversion: 2.1 time: 0.313638 May 26 12:54:14.953784 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 411/818] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:54:14 2022] GET /compute/v2.1/servers/f24cf723-09f4-49a6-8e36-13cccb384169 => generated 1265 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:54:14.956046 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 408/819] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:54:14 2022] GET /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7 => generated 1549 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:54:14.967107 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-6859243c-8c06-48bb-a828-c4d2fe9902cd tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:14.967810 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-6859243c-8c06-48bb-a828-c4d2fe9902cd tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] [instance: 7f3fde81-3f47-4590-ad2e-330bd31ed1f7] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:14.981453 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-6859243c-8c06-48bb-a828-c4d2fe9902cd tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:14.981951 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-6859243c-8c06-48bb-a828-c4d2fe9902cd tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:14.982896 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-6859243c-8c06-48bb-a828-c4d2fe9902cd tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:14.983344 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-6859243c-8c06-48bb-a828-c4d2fe9902cd tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:15.087536 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-6859243c-8c06-48bb-a828-c4d2fe9902cd tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] 10.222.0.41 "GET /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.121944 May 26 12:54:15.087536 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 412/820] 10.222.0.41 () {58 vars in 1274 bytes} [Thu May 26 12:54:14 2022] GET /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7/os-interface => generated 284 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:54:15.225894 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [req-8b9a46ab-90e4-4f18-abaf-85c4e92f208e req-b01f4f30-b947-4943-a561-67be7ca26ef3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1efb756-8e30-4c05-9156-de4ae119ac3c", "tag": "114a1a6a-836f-4257-81d6-756de175e28e"}]} {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:54:15.239544 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [req-8b9a46ab-90e4-4f18-abaf-85c4e92f208e req-b01f4f30-b947-4943-a561-67be7ca26ef3 service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:15.240000 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [req-8b9a46ab-90e4-4f18-abaf-85c4e92f208e req-b01f4f30-b947-4943-a561-67be7ca26ef3 service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:15.259991 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.compute.server_external_events [req-8b9a46ab-90e4-4f18-abaf-85c4e92f208e req-b01f4f30-b947-4943-a561-67be7ca26ef3 service nova] Creating event network-changed:114a1a6a-836f-4257-81d6-756de175e28e for instance d1efb756-8e30-4c05-9156-de4ae119ac3c on hv-cinder-81571 May 26 12:54:15.270943 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [req-8b9a46ab-90e4-4f18-abaf-85c4e92f208e req-b01f4f30-b947-4943-a561-67be7ca26ef3 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052052 May 26 12:54:15.271824 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 409/821] 10.222.0.41 () {64 vars in 1317 bytes} [Thu May 26 12:54:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:54:15.968546 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-61fc6c0e-2f9d-4713-9e0a-1fec79a9d241 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:15.970415 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-61fc6c0e-2f9d-4713-9e0a-1fec79a9d241 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] [instance: f24cf723-09f4-49a6-8e36-13cccb384169] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:15.979050 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-61fc6c0e-2f9d-4713-9e0a-1fec79a9d241 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:15.980010 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-61fc6c0e-2f9d-4713-9e0a-1fec79a9d241 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:15.981093 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-61fc6c0e-2f9d-4713-9e0a-1fec79a9d241 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:15.981924 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-61fc6c0e-2f9d-4713-9e0a-1fec79a9d241 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:16.438530 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-61fc6c0e-2f9d-4713-9e0a-1fec79a9d241 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47d51863b0448b880dc03b01dec6dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23568023763549669484e71430e34389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:54:16.450110 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-61fc6c0e-2f9d-4713-9e0a-1fec79a9d241 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] 10.222.0.41 "GET /compute/v2.1/servers/f24cf723-09f4-49a6-8e36-13cccb384169" status: 200 len: 1265 microversion: 2.1 time: 0.482128 May 26 12:54:16.450110 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 413/822] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:54:15 2022] GET /compute/v2.1/servers/f24cf723-09f4-49a6-8e36-13cccb384169 => generated 1265 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:54:17.286855 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [req-d38dcdce-7b3b-4697-b49d-4db4949438fc req-1c387146-a8a1-4d1d-abde-bdf4e3c3443f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f3fde81-3f47-4590-ad2e-330bd31ed1f7", "tag": "24bce984-312f-419b-85cf-8dba81242975"}]} {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:54:17.292568 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG dbcounter [-] [124824] Writing DB stats nova_cell0:SELECT=4 {{(pid=124824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:54:17.293262 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG dbcounter [-] [124824] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=124824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:54:17.297542 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [req-d38dcdce-7b3b-4697-b49d-4db4949438fc req-1c387146-a8a1-4d1d-abde-bdf4e3c3443f service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:17.298024 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [req-d38dcdce-7b3b-4697-b49d-4db4949438fc req-1c387146-a8a1-4d1d-abde-bdf4e3c3443f service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:17.311886 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.compute.server_external_events [req-d38dcdce-7b3b-4697-b49d-4db4949438fc req-1c387146-a8a1-4d1d-abde-bdf4e3c3443f service nova] Creating event network-changed:24bce984-312f-419b-85cf-8dba81242975 for instance 7f3fde81-3f47-4590-ad2e-330bd31ed1f7 on hv-cinder-81571 May 26 12:54:17.317360 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [req-d38dcdce-7b3b-4697-b49d-4db4949438fc req-1c387146-a8a1-4d1d-abde-bdf4e3c3443f service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034458 May 26 12:54:17.320664 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 410/823] 10.222.0.41 () {64 vars in 1317 bytes} [Thu May 26 12:54:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:54:17.464017 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-3948c8f0-68bf-488d-be15-dbdd07eec168 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:17.464792 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-3948c8f0-68bf-488d-be15-dbdd07eec168 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] [instance: f24cf723-09f4-49a6-8e36-13cccb384169] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:17.471798 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-3948c8f0-68bf-488d-be15-dbdd07eec168 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:17.472325 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-3948c8f0-68bf-488d-be15-dbdd07eec168 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:17.473358 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-3948c8f0-68bf-488d-be15-dbdd07eec168 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:17.473947 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-3948c8f0-68bf-488d-be15-dbdd07eec168 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:17.672150 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-3948c8f0-68bf-488d-be15-dbdd07eec168 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47d51863b0448b880dc03b01dec6dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23568023763549669484e71430e34389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:54:17.680714 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-3948c8f0-68bf-488d-be15-dbdd07eec168 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] 10.222.0.41 "GET /compute/v2.1/servers/f24cf723-09f4-49a6-8e36-13cccb384169" status: 200 len: 1265 microversion: 2.1 time: 0.220436 May 26 12:54:17.681296 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 414/824] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:54:17 2022] GET /compute/v2.1/servers/f24cf723-09f4-49a6-8e36-13cccb384169 => generated 1265 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:54:18.237365 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG dbcounter [-] [124824] Writing DB stats nova_cell0:SELECT=14 {{(pid=124824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:54:18.241970 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-881c5ee6-c478-48e4-b260-73efa23d38ca tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1620363328"}} {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:54:18.242600 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-881c5ee6-c478-48e4-b260-73efa23d38ca tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] [instance: d1efb756-8e30-4c05-9156-de4ae119ac3c] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:18.249577 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-881c5ee6-c478-48e4-b260-73efa23d38ca tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:18.250125 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-881c5ee6-c478-48e4-b260-73efa23d38ca tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:18.250908 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-881c5ee6-c478-48e4-b260-73efa23d38ca tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:18.251351 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-881c5ee6-c478-48e4-b260-73efa23d38ca tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:18.378719 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.network.security_group_api [None req-881c5ee6-c478-48e4-b260-73efa23d38ca tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Adding security group 775e2963-7f6f-4932-a16e-e3eeb135a7ed to port 114a1a6a-836f-4257-81d6-756de175e28e May 26 12:54:18.700795 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-bdbae213-08b3-4404-80e2-e6aa5aa3b29c tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:18.701407 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-bdbae213-08b3-4404-80e2-e6aa5aa3b29c tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] [instance: f24cf723-09f4-49a6-8e36-13cccb384169] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:18.709954 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-bdbae213-08b3-4404-80e2-e6aa5aa3b29c tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:18.710631 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-bdbae213-08b3-4404-80e2-e6aa5aa3b29c tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:18.711406 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-bdbae213-08b3-4404-80e2-e6aa5aa3b29c tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:18.711837 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-bdbae213-08b3-4404-80e2-e6aa5aa3b29c tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:18.821694 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-881c5ee6-c478-48e4-b260-73efa23d38ca tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] 10.222.0.41 "POST /compute/v2.1/servers/d1efb756-8e30-4c05-9156-de4ae119ac3c/action" status: 202 len: 0 microversion: 2.1 time: 0.585106 May 26 12:54:18.823160 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 411/825] 10.222.0.41 () {60 vars in 1277 bytes} [Thu May 26 12:54:18 2022] POST /compute/v2.1/servers/d1efb756-8e30-4c05-9156-de4ae119ac3c/action => generated 0 bytes in 588 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 12:54:18.833069 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-8ef76e9c-611b-4648-af86-cd082cc3a4a7 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:18.834586 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-8ef76e9c-611b-4648-af86-cd082cc3a4a7 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] [instance: d1efb756-8e30-4c05-9156-de4ae119ac3c] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:18.841536 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-8ef76e9c-611b-4648-af86-cd082cc3a4a7 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:18.842269 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-8ef76e9c-611b-4648-af86-cd082cc3a4a7 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:18.843532 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-8ef76e9c-611b-4648-af86-cd082cc3a4a7 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:18.844133 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-8ef76e9c-611b-4648-af86-cd082cc3a4a7 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:18.881704 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-bdbae213-08b3-4404-80e2-e6aa5aa3b29c tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47d51863b0448b880dc03b01dec6dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23568023763549669484e71430e34389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:54:18.893773 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-bdbae213-08b3-4404-80e2-e6aa5aa3b29c tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] 10.222.0.41 "GET /compute/v2.1/servers/f24cf723-09f4-49a6-8e36-13cccb384169" status: 200 len: 1265 microversion: 2.1 time: 0.198307 May 26 12:54:18.894865 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 415/826] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:54:18 2022] GET /compute/v2.1/servers/f24cf723-09f4-49a6-8e36-13cccb384169 => generated 1265 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:54:18.909224 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [req-5d259a70-f82f-4f18-bb18-bff6bd28f398 req-b634aeda-0004-4463-931c-af22728832c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1efb756-8e30-4c05-9156-de4ae119ac3c", "tag": "114a1a6a-836f-4257-81d6-756de175e28e"}]} {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:54:18.920842 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [req-5d259a70-f82f-4f18-bb18-bff6bd28f398 req-b634aeda-0004-4463-931c-af22728832c6 service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:18.921413 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [req-5d259a70-f82f-4f18-bb18-bff6bd28f398 req-b634aeda-0004-4463-931c-af22728832c6 service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:18.936493 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.compute.server_external_events [req-5d259a70-f82f-4f18-bb18-bff6bd28f398 req-b634aeda-0004-4463-931c-af22728832c6 service nova] Creating event network-changed:114a1a6a-836f-4257-81d6-756de175e28e for instance d1efb756-8e30-4c05-9156-de4ae119ac3c on hv-cinder-81571 May 26 12:54:18.945025 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [req-5d259a70-f82f-4f18-bb18-bff6bd28f398 req-b634aeda-0004-4463-931c-af22728832c6 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048403 May 26 12:54:18.945545 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 416/827] 10.222.0.41 () {64 vars in 1317 bytes} [Thu May 26 12:54:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:54:19.095730 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-8ef76e9c-611b-4648-af86-cd082cc3a4a7 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7277aedb35df448e8b3056f8bc395e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c876091609fe45ba80370a16748cbeb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:54:19.115160 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-8ef76e9c-611b-4648-af86-cd082cc3a4a7 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] 10.222.0.41 "GET /compute/v2.1/servers/d1efb756-8e30-4c05-9156-de4ae119ac3c" status: 200 len: 1762 microversion: 2.1 time: 0.283906 May 26 12:54:19.115160 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 412/828] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:54:18 2022] GET /compute/v2.1/servers/d1efb756-8e30-4c05-9156-de4ae119ac3c => generated 1762 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:54:19.911936 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-83a5f46f-ae89-47ba-bac9-77cc713d5154 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:19.912647 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-83a5f46f-ae89-47ba-bac9-77cc713d5154 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] [instance: f24cf723-09f4-49a6-8e36-13cccb384169] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:19.919435 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-83a5f46f-ae89-47ba-bac9-77cc713d5154 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:19.919880 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-83a5f46f-ae89-47ba-bac9-77cc713d5154 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:19.920739 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-83a5f46f-ae89-47ba-bac9-77cc713d5154 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:19.921167 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-83a5f46f-ae89-47ba-bac9-77cc713d5154 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:20.054327 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-83a5f46f-ae89-47ba-bac9-77cc713d5154 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47d51863b0448b880dc03b01dec6dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23568023763549669484e71430e34389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:54:20.061891 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-83a5f46f-ae89-47ba-bac9-77cc713d5154 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] 10.222.0.41 "GET /compute/v2.1/servers/f24cf723-09f4-49a6-8e36-13cccb384169" status: 200 len: 1265 microversion: 2.1 time: 0.154270 May 26 12:54:20.062458 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 417/829] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:54:19 2022] GET /compute/v2.1/servers/f24cf723-09f4-49a6-8e36-13cccb384169 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:54:21.078627 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-bd677d6d-3878-42ca-b37f-bf0a29e4c41a tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:21.079346 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-bd677d6d-3878-42ca-b37f-bf0a29e4c41a tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] [instance: f24cf723-09f4-49a6-8e36-13cccb384169] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:21.086091 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-bd677d6d-3878-42ca-b37f-bf0a29e4c41a tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:21.086538 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-bd677d6d-3878-42ca-b37f-bf0a29e4c41a tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:21.087307 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-bd677d6d-3878-42ca-b37f-bf0a29e4c41a tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:21.087736 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-bd677d6d-3878-42ca-b37f-bf0a29e4c41a tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:21.229519 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-bd677d6d-3878-42ca-b37f-bf0a29e4c41a tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47d51863b0448b880dc03b01dec6dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23568023763549669484e71430e34389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:54:21.237439 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-bd677d6d-3878-42ca-b37f-bf0a29e4c41a tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] 10.222.0.41 "GET /compute/v2.1/servers/f24cf723-09f4-49a6-8e36-13cccb384169" status: 200 len: 1265 microversion: 2.1 time: 0.162744 May 26 12:54:21.238043 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 413/830] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:54:21 2022] GET /compute/v2.1/servers/f24cf723-09f4-49a6-8e36-13cccb384169 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:54:22.254973 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-6685af62-15a6-453d-9876-811a0982c2d8 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:22.255585 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-6685af62-15a6-453d-9876-811a0982c2d8 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] [instance: f24cf723-09f4-49a6-8e36-13cccb384169] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:22.262244 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-6685af62-15a6-453d-9876-811a0982c2d8 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:22.262765 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-6685af62-15a6-453d-9876-811a0982c2d8 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:22.263614 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-6685af62-15a6-453d-9876-811a0982c2d8 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:22.264130 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-6685af62-15a6-453d-9876-811a0982c2d8 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:22.402450 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-6685af62-15a6-453d-9876-811a0982c2d8 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47d51863b0448b880dc03b01dec6dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23568023763549669484e71430e34389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:54:22.410494 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-6685af62-15a6-453d-9876-811a0982c2d8 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] 10.222.0.41 "GET /compute/v2.1/servers/f24cf723-09f4-49a6-8e36-13cccb384169" status: 200 len: 1265 microversion: 2.1 time: 0.159443 May 26 12:54:22.411061 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 418/831] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:54:22 2022] GET /compute/v2.1/servers/f24cf723-09f4-49a6-8e36-13cccb384169 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:54:23.427946 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-8ab9d9da-e26a-40dc-879a-d95ac9024a8d tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:23.428423 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-8ab9d9da-e26a-40dc-879a-d95ac9024a8d tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] [instance: f24cf723-09f4-49a6-8e36-13cccb384169] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:23.438101 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-8ab9d9da-e26a-40dc-879a-d95ac9024a8d tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:23.438906 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-8ab9d9da-e26a-40dc-879a-d95ac9024a8d tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:23.439372 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-8ab9d9da-e26a-40dc-879a-d95ac9024a8d tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:23.439810 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-8ab9d9da-e26a-40dc-879a-d95ac9024a8d tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:23.570526 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-8ab9d9da-e26a-40dc-879a-d95ac9024a8d tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47d51863b0448b880dc03b01dec6dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23568023763549669484e71430e34389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:54:23.577940 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-8ab9d9da-e26a-40dc-879a-d95ac9024a8d tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] 10.222.0.41 "GET /compute/v2.1/servers/f24cf723-09f4-49a6-8e36-13cccb384169" status: 200 len: 1265 microversion: 2.1 time: 0.154377 May 26 12:54:23.578506 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 414/832] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:54:23 2022] GET /compute/v2.1/servers/f24cf723-09f4-49a6-8e36-13cccb384169 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:54:24.243890 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [req-a5890228-02e0-4998-9cfe-0ddef6b9e0f1 req-8e7f5d83-87ed-4116-b09f-e3ade44a341d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f24cf723-09f4-49a6-8e36-13cccb384169", "name": "network-vif-plugged", "status": "completed", "tag": "d96fa6eb-c6ec-48b5-a0bf-bec9d462a6d5"}]} {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:54:24.252363 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [req-a5890228-02e0-4998-9cfe-0ddef6b9e0f1 req-8e7f5d83-87ed-4116-b09f-e3ade44a341d service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:24.252831 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [req-a5890228-02e0-4998-9cfe-0ddef6b9e0f1 req-8e7f5d83-87ed-4116-b09f-e3ade44a341d service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:24.263455 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.compute.server_external_events [req-a5890228-02e0-4998-9cfe-0ddef6b9e0f1 req-8e7f5d83-87ed-4116-b09f-e3ade44a341d service nova] Creating event network-vif-plugged:d96fa6eb-c6ec-48b5-a0bf-bec9d462a6d5 for instance f24cf723-09f4-49a6-8e36-13cccb384169 on hv-cinder-81571 May 26 12:54:24.268951 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [req-a5890228-02e0-4998-9cfe-0ddef6b9e0f1 req-8e7f5d83-87ed-4116-b09f-e3ade44a341d service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028828 May 26 12:54:24.269583 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 419/833] 10.222.0.41 () {64 vars in 1317 bytes} [Thu May 26 12:54:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:54:24.597291 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-b3c72914-8920-4beb-a10f-b1e0f9a30c1d tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:24.598045 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-b3c72914-8920-4beb-a10f-b1e0f9a30c1d tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] [instance: f24cf723-09f4-49a6-8e36-13cccb384169] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:24.604759 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-b3c72914-8920-4beb-a10f-b1e0f9a30c1d tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:24.605210 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-b3c72914-8920-4beb-a10f-b1e0f9a30c1d tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:24.606025 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-b3c72914-8920-4beb-a10f-b1e0f9a30c1d tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:24.606462 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-b3c72914-8920-4beb-a10f-b1e0f9a30c1d tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:24.775415 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-b3c72914-8920-4beb-a10f-b1e0f9a30c1d tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47d51863b0448b880dc03b01dec6dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23568023763549669484e71430e34389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:54:24.782891 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-b3c72914-8920-4beb-a10f-b1e0f9a30c1d tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] 10.222.0.41 "GET /compute/v2.1/servers/f24cf723-09f4-49a6-8e36-13cccb384169" status: 200 len: 1265 microversion: 2.1 time: 0.191406 May 26 12:54:24.787248 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 415/834] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:54:24 2022] GET /compute/v2.1/servers/f24cf723-09f4-49a6-8e36-13cccb384169 => generated 1265 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:54:25.800838 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-92fdd5ea-6327-4dc8-918f-428d0253a5c7 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:25.801536 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-92fdd5ea-6327-4dc8-918f-428d0253a5c7 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] [instance: f24cf723-09f4-49a6-8e36-13cccb384169] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:25.808665 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-92fdd5ea-6327-4dc8-918f-428d0253a5c7 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:25.809134 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-92fdd5ea-6327-4dc8-918f-428d0253a5c7 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:25.809931 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-92fdd5ea-6327-4dc8-918f-428d0253a5c7 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:25.810392 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-92fdd5ea-6327-4dc8-918f-428d0253a5c7 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:25.953325 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-92fdd5ea-6327-4dc8-918f-428d0253a5c7 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47d51863b0448b880dc03b01dec6dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23568023763549669484e71430e34389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:54:25.962624 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-92fdd5ea-6327-4dc8-918f-428d0253a5c7 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] 10.222.0.41 "GET /compute/v2.1/servers/f24cf723-09f4-49a6-8e36-13cccb384169" status: 200 len: 1265 microversion: 2.1 time: 0.166604 May 26 12:54:25.963201 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 420/835] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:54:25 2022] GET /compute/v2.1/servers/f24cf723-09f4-49a6-8e36-13cccb384169 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:54:26.980338 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-8060ca9f-9bad-41f1-ad88-5e2edc0592d6 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:26.980991 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-8060ca9f-9bad-41f1-ad88-5e2edc0592d6 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] [instance: f24cf723-09f4-49a6-8e36-13cccb384169] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:26.988380 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-8060ca9f-9bad-41f1-ad88-5e2edc0592d6 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:26.988907 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-8060ca9f-9bad-41f1-ad88-5e2edc0592d6 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:26.989687 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-8060ca9f-9bad-41f1-ad88-5e2edc0592d6 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:26.990126 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-8060ca9f-9bad-41f1-ad88-5e2edc0592d6 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:27.127415 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-8060ca9f-9bad-41f1-ad88-5e2edc0592d6 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47d51863b0448b880dc03b01dec6dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23568023763549669484e71430e34389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:54:27.134952 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-8060ca9f-9bad-41f1-ad88-5e2edc0592d6 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] 10.222.0.41 "GET /compute/v2.1/servers/f24cf723-09f4-49a6-8e36-13cccb384169" status: 200 len: 1453 microversion: 2.1 time: 0.158511 May 26 12:54:27.135572 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 416/836] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:54:26 2022] GET /compute/v2.1/servers/f24cf723-09f4-49a6-8e36-13cccb384169 => generated 1453 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:54:27.151188 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-c5827032-e005-4fba-a7f7-b3f9a52450fb tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:27.151726 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-c5827032-e005-4fba-a7f7-b3f9a52450fb tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] [instance: f24cf723-09f4-49a6-8e36-13cccb384169] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:27.154210 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG dbcounter [-] [124823] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3 {{(pid=124823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:54:27.159482 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-c5827032-e005-4fba-a7f7-b3f9a52450fb tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:27.159926 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-c5827032-e005-4fba-a7f7-b3f9a52450fb tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:27.160686 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-c5827032-e005-4fba-a7f7-b3f9a52450fb tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:27.161116 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-c5827032-e005-4fba-a7f7-b3f9a52450fb tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:27.296019 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-c5827032-e005-4fba-a7f7-b3f9a52450fb tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47d51863b0448b880dc03b01dec6dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23568023763549669484e71430e34389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:54:27.303576 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-c5827032-e005-4fba-a7f7-b3f9a52450fb tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] 10.222.0.41 "GET /compute/v2.1/servers/f24cf723-09f4-49a6-8e36-13cccb384169" status: 200 len: 1453 microversion: 2.1 time: 0.156281 May 26 12:54:27.304141 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 421/837] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:54:27 2022] GET /compute/v2.1/servers/f24cf723-09f4-49a6-8e36-13cccb384169 => generated 1453 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:54:29.527594 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [req-07d83da6-e739-41eb-b8a3-01964ca5a652 req-9af2f185-b89e-4dc1-be39-ad3dd73ff450 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f24cf723-09f4-49a6-8e36-13cccb384169", "tag": "d96fa6eb-c6ec-48b5-a0bf-bec9d462a6d5"}]} {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:54:29.536299 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [req-07d83da6-e739-41eb-b8a3-01964ca5a652 req-9af2f185-b89e-4dc1-be39-ad3dd73ff450 service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:29.536736 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [req-07d83da6-e739-41eb-b8a3-01964ca5a652 req-9af2f185-b89e-4dc1-be39-ad3dd73ff450 service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:29.550463 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.compute.server_external_events [req-07d83da6-e739-41eb-b8a3-01964ca5a652 req-9af2f185-b89e-4dc1-be39-ad3dd73ff450 service nova] Creating event network-changed:d96fa6eb-c6ec-48b5-a0bf-bec9d462a6d5 for instance f24cf723-09f4-49a6-8e36-13cccb384169 on hv-cinder-81571 May 26 12:54:29.555342 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [req-07d83da6-e739-41eb-b8a3-01964ca5a652 req-9af2f185-b89e-4dc1-be39-ad3dd73ff450 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031150 May 26 12:54:29.556475 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 417/838] 10.222.0.41 () {64 vars in 1317 bytes} [Thu May 26 12:54:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:54:38.603996 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-553c01e7-bdc2-4acd-b143-c9a66cdc77c7 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:54:38.604864 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-553c01e7-bdc2-4acd-b143-c9a66cdc77c7 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] [instance: d1efb756-8e30-4c05-9156-de4ae119ac3c] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:38.607672 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG dbcounter [-] [124823] Writing DB stats nova_cell1:SELECT=74 {{(pid=124823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:54:38.614736 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-553c01e7-bdc2-4acd-b143-c9a66cdc77c7 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:38.615466 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-553c01e7-bdc2-4acd-b143-c9a66cdc77c7 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:38.616943 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-553c01e7-bdc2-4acd-b143-c9a66cdc77c7 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:38.617634 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-553c01e7-bdc2-4acd-b143-c9a66cdc77c7 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:38.849349 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-553c01e7-bdc2-4acd-b143-c9a66cdc77c7 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] 10.222.0.41 "POST /compute/v2.1/servers/d1efb756-8e30-4c05-9156-de4ae119ac3c/action" status: 202 len: 0 microversion: 2.1 time: 0.248395 May 26 12:54:38.852810 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 422/839] 10.222.0.41 () {60 vars in 1277 bytes} [Thu May 26 12:54:38 2022] POST /compute/v2.1/servers/d1efb756-8e30-4c05-9156-de4ae119ac3c/action => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 12:54:38.859301 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-39175e88-db90-44e9-b5e2-337a498b8507 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:38.860021 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-39175e88-db90-44e9-b5e2-337a498b8507 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] [instance: d1efb756-8e30-4c05-9156-de4ae119ac3c] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:38.870341 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-39175e88-db90-44e9-b5e2-337a498b8507 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:38.870851 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-39175e88-db90-44e9-b5e2-337a498b8507 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:38.871667 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-39175e88-db90-44e9-b5e2-337a498b8507 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:38.872084 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-39175e88-db90-44e9-b5e2-337a498b8507 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:38.875209 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG dbcounter [-] [124824] Writing DB stats nova_cell1:SELECT=89 {{(pid=124824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:54:39.068414 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-39175e88-db90-44e9-b5e2-337a498b8507 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7277aedb35df448e8b3056f8bc395e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c876091609fe45ba80370a16748cbeb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:54:39.091971 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-39175e88-db90-44e9-b5e2-337a498b8507 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] 10.222.0.41 "GET /compute/v2.1/servers/d1efb756-8e30-4c05-9156-de4ae119ac3c" status: 200 len: 1754 microversion: 2.1 time: 0.237490 May 26 12:54:39.095827 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 418/840] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:54:38 2022] GET /compute/v2.1/servers/d1efb756-8e30-4c05-9156-de4ae119ac3c => generated 1754 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:54:40.110229 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-dd4d3b19-a1f9-4b68-b14b-3e5607dc6f78 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:40.111072 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-dd4d3b19-a1f9-4b68-b14b-3e5607dc6f78 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] [instance: d1efb756-8e30-4c05-9156-de4ae119ac3c] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:40.117882 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-dd4d3b19-a1f9-4b68-b14b-3e5607dc6f78 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:40.118324 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-dd4d3b19-a1f9-4b68-b14b-3e5607dc6f78 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:40.119099 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-dd4d3b19-a1f9-4b68-b14b-3e5607dc6f78 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:40.119522 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-dd4d3b19-a1f9-4b68-b14b-3e5607dc6f78 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:40.283132 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-dd4d3b19-a1f9-4b68-b14b-3e5607dc6f78 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7277aedb35df448e8b3056f8bc395e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c876091609fe45ba80370a16748cbeb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:54:40.291304 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-dd4d3b19-a1f9-4b68-b14b-3e5607dc6f78 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] 10.222.0.41 "GET /compute/v2.1/servers/d1efb756-8e30-4c05-9156-de4ae119ac3c" status: 200 len: 1759 microversion: 2.1 time: 0.185345 May 26 12:54:40.291851 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 423/841] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:54:40 2022] GET /compute/v2.1/servers/d1efb756-8e30-4c05-9156-de4ae119ac3c => generated 1759 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:54:41.308192 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-904eeda1-2cf0-494d-80c4-a7e6f8ba791e tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:41.308820 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-904eeda1-2cf0-494d-80c4-a7e6f8ba791e tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] [instance: d1efb756-8e30-4c05-9156-de4ae119ac3c] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:41.315628 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-904eeda1-2cf0-494d-80c4-a7e6f8ba791e tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:41.316098 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-904eeda1-2cf0-494d-80c4-a7e6f8ba791e tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:41.316881 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-904eeda1-2cf0-494d-80c4-a7e6f8ba791e tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:41.317327 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-904eeda1-2cf0-494d-80c4-a7e6f8ba791e tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:41.467590 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-904eeda1-2cf0-494d-80c4-a7e6f8ba791e tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7277aedb35df448e8b3056f8bc395e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c876091609fe45ba80370a16748cbeb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:54:41.476426 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-904eeda1-2cf0-494d-80c4-a7e6f8ba791e tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] 10.222.0.41 "GET /compute/v2.1/servers/d1efb756-8e30-4c05-9156-de4ae119ac3c" status: 200 len: 1759 microversion: 2.1 time: 0.172060 May 26 12:54:41.476993 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 419/842] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:54:41 2022] GET /compute/v2.1/servers/d1efb756-8e30-4c05-9156-de4ae119ac3c => generated 1759 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:54:42.493571 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-3dab7b10-a551-4dc5-94f0-f4751ecb7ac6 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:42.496305 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-3dab7b10-a551-4dc5-94f0-f4751ecb7ac6 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] [instance: d1efb756-8e30-4c05-9156-de4ae119ac3c] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:42.500932 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-3dab7b10-a551-4dc5-94f0-f4751ecb7ac6 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:42.501370 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-3dab7b10-a551-4dc5-94f0-f4751ecb7ac6 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:42.502789 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-3dab7b10-a551-4dc5-94f0-f4751ecb7ac6 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:42.503221 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-3dab7b10-a551-4dc5-94f0-f4751ecb7ac6 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:42.666022 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-3dab7b10-a551-4dc5-94f0-f4751ecb7ac6 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7277aedb35df448e8b3056f8bc395e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c876091609fe45ba80370a16748cbeb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:54:42.675088 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-3dab7b10-a551-4dc5-94f0-f4751ecb7ac6 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] 10.222.0.41 "GET /compute/v2.1/servers/d1efb756-8e30-4c05-9156-de4ae119ac3c" status: 200 len: 1759 microversion: 2.1 time: 0.185516 May 26 12:54:42.675675 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 424/843] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:54:42 2022] GET /compute/v2.1/servers/d1efb756-8e30-4c05-9156-de4ae119ac3c => generated 1759 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:54:43.692660 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-67725953-41f6-4d02-a866-25ba7fb9a324 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:43.693270 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-67725953-41f6-4d02-a866-25ba7fb9a324 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] [instance: d1efb756-8e30-4c05-9156-de4ae119ac3c] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:43.699758 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-67725953-41f6-4d02-a866-25ba7fb9a324 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:43.700196 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-67725953-41f6-4d02-a866-25ba7fb9a324 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:43.701037 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-67725953-41f6-4d02-a866-25ba7fb9a324 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:43.701469 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-67725953-41f6-4d02-a866-25ba7fb9a324 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:43.847708 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-67725953-41f6-4d02-a866-25ba7fb9a324 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7277aedb35df448e8b3056f8bc395e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c876091609fe45ba80370a16748cbeb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:54:43.855795 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-67725953-41f6-4d02-a866-25ba7fb9a324 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] 10.222.0.41 "GET /compute/v2.1/servers/d1efb756-8e30-4c05-9156-de4ae119ac3c" status: 200 len: 1759 microversion: 2.1 time: 0.167494 May 26 12:54:43.856371 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 420/844] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:54:43 2022] GET /compute/v2.1/servers/d1efb756-8e30-4c05-9156-de4ae119ac3c => generated 1759 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:54:44.873795 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-de978df7-dbeb-436f-a2bb-c93f04c47c8b tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:44.874396 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-de978df7-dbeb-436f-a2bb-c93f04c47c8b tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] [instance: d1efb756-8e30-4c05-9156-de4ae119ac3c] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:44.881221 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-de978df7-dbeb-436f-a2bb-c93f04c47c8b tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:44.881712 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-de978df7-dbeb-436f-a2bb-c93f04c47c8b tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:44.882453 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-de978df7-dbeb-436f-a2bb-c93f04c47c8b tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:44.882882 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-de978df7-dbeb-436f-a2bb-c93f04c47c8b tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:45.036569 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-de978df7-dbeb-436f-a2bb-c93f04c47c8b tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7277aedb35df448e8b3056f8bc395e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c876091609fe45ba80370a16748cbeb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:54:45.044510 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-de978df7-dbeb-436f-a2bb-c93f04c47c8b tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] 10.222.0.41 "GET /compute/v2.1/servers/d1efb756-8e30-4c05-9156-de4ae119ac3c" status: 200 len: 1759 microversion: 2.1 time: 0.174623 May 26 12:54:45.045079 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 425/845] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:54:44 2022] GET /compute/v2.1/servers/d1efb756-8e30-4c05-9156-de4ae119ac3c => generated 1759 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:54:46.061841 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-a54e0b11-ed27-4fdc-8ad9-56525e409b9e tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:46.062560 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-a54e0b11-ed27-4fdc-8ad9-56525e409b9e tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] [instance: d1efb756-8e30-4c05-9156-de4ae119ac3c] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:46.069015 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-a54e0b11-ed27-4fdc-8ad9-56525e409b9e tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:46.069467 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-a54e0b11-ed27-4fdc-8ad9-56525e409b9e tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:46.070261 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-a54e0b11-ed27-4fdc-8ad9-56525e409b9e tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:46.070702 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-a54e0b11-ed27-4fdc-8ad9-56525e409b9e tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:46.223364 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-a54e0b11-ed27-4fdc-8ad9-56525e409b9e tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7277aedb35df448e8b3056f8bc395e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c876091609fe45ba80370a16748cbeb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:54:46.231321 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-a54e0b11-ed27-4fdc-8ad9-56525e409b9e tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] 10.222.0.41 "GET /compute/v2.1/servers/d1efb756-8e30-4c05-9156-de4ae119ac3c" status: 200 len: 1759 microversion: 2.1 time: 0.173701 May 26 12:54:46.231917 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 421/846] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:54:46 2022] GET /compute/v2.1/servers/d1efb756-8e30-4c05-9156-de4ae119ac3c => generated 1759 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:54:47.199146 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-cf4a1655-b0ac-4012-9da2-182451cf8ec9 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1963831906", "imageRef": "6df25342-b071-489b-a7c1-3089fa19af6d", "flavorRef": "452", "networks": [{"uuid": "1dd72085-b5d2-4570-91e3-b99c8ca7e205"}]}} {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:54:47.248525 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-6c683cc7-853f-4756-b2c3-6054d8e5795e tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:47.249149 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-6c683cc7-853f-4756-b2c3-6054d8e5795e tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] [instance: d1efb756-8e30-4c05-9156-de4ae119ac3c] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:47.251206 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.network.neutron [None req-cf4a1655-b0ac-4012-9da2-182451cf8ec9 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] validate_networks() for [('1dd72085-b5d2-4570-91e3-b99c8ca7e205', None, None, None, None, None)] {{(pid=124823) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 12:54:47.255716 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-6c683cc7-853f-4756-b2c3-6054d8e5795e tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:47.256170 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-6c683cc7-853f-4756-b2c3-6054d8e5795e tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:47.256945 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-6c683cc7-853f-4756-b2c3-6054d8e5795e tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:47.257387 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-6c683cc7-853f-4756-b2c3-6054d8e5795e tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:47.406267 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-6c683cc7-853f-4756-b2c3-6054d8e5795e tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7277aedb35df448e8b3056f8bc395e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c876091609fe45ba80370a16748cbeb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:54:47.415075 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-6c683cc7-853f-4756-b2c3-6054d8e5795e tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] 10.222.0.41 "GET /compute/v2.1/servers/d1efb756-8e30-4c05-9156-de4ae119ac3c" status: 200 len: 1759 microversion: 2.1 time: 0.170325 May 26 12:54:47.417112 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 422/847] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:54:47 2022] GET /compute/v2.1/servers/d1efb756-8e30-4c05-9156-de4ae119ac3c => generated 1759 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:54:47.827204 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.virt.hardware [None req-cf4a1655-b0ac-4012-9da2-182451cf8ec9 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Flavor limits 0:0:0 {{(pid=124823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 12:54:47.827640 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.virt.hardware [None req-cf4a1655-b0ac-4012-9da2-182451cf8ec9 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Image limits 0:0:0 {{(pid=124823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 12:54:47.828118 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.virt.hardware [None req-cf4a1655-b0ac-4012-9da2-182451cf8ec9 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Flavor pref 0:0:0 {{(pid=124823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 12:54:47.828556 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.virt.hardware [None req-cf4a1655-b0ac-4012-9da2-182451cf8ec9 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Image pref 0:0:0 {{(pid=124823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 12:54:47.829027 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.virt.hardware [None req-cf4a1655-b0ac-4012-9da2-182451cf8ec9 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 12:54:47.838854 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-cf4a1655-b0ac-4012-9da2-182451cf8ec9 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:47.839300 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-cf4a1655-b0ac-4012-9da2-182451cf8ec9 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:47.840098 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-cf4a1655-b0ac-4012-9da2-182451cf8ec9 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:47.840534 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-cf4a1655-b0ac-4012-9da2-182451cf8ec9 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:47.857567 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.quota [None req-cf4a1655-b0ac-4012-9da2-182451cf8ec9 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Getting quotas for project 6a43dd5e9d7841419a87df430827af67. Resources: {'instances', 'ram', 'cores'} {{(pid=124823) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:54:47.861481 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.quota [None req-cf4a1655-b0ac-4012-9da2-182451cf8ec9 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Getting quotas for user f1cdcc03aee2493eb40013a66243cf38 and project 6a43dd5e9d7841419a87df430827af67. Resources: {'instances', 'ram', 'cores'} {{(pid=124823) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:54:47.872294 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-cf4a1655-b0ac-4012-9da2-182451cf8ec9 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Going to run 1 instances... {{(pid=124823) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 12:54:47.874623 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-cf4a1655-b0ac-4012-9da2-182451cf8ec9 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] [instance: 36055083-9302-436b-b724-512117ae5dfc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6df25342-b071-489b-a7c1-3089fa19af6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124823) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 12:54:48.020662 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-cf4a1655-b0ac-4012-9da2-182451cf8ec9 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.825301 May 26 12:54:48.021228 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 426/848] 10.222.0.41 () {60 vars in 1146 bytes} [Thu May 26 12:54:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 827 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 12:54:48.031161 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-cebfed79-0873-493f-b783-5f27d2edf3b0 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:48.031766 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-cebfed79-0873-493f-b783-5f27d2edf3b0 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] [instance: 36055083-9302-436b-b724-512117ae5dfc] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:48.085815 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-cebfed79-0873-493f-b783-5f27d2edf3b0 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1cdcc03aee2493eb40013a66243cf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a43dd5e9d7841419a87df430827af67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:54:48.092888 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-cebfed79-0873-493f-b783-5f27d2edf3b0 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] 10.222.0.41 "GET /compute/v2.1/servers/36055083-9302-436b-b724-512117ae5dfc" status: 200 len: 1214 microversion: 2.1 time: 0.065573 May 26 12:54:48.093481 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 423/849] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:54:48 2022] GET /compute/v2.1/servers/36055083-9302-436b-b724-512117ae5dfc => generated 1214 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:54:48.432865 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-b775dc7b-5a8d-49e1-b242-e4dc7a94c5d4 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:48.433482 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-b775dc7b-5a8d-49e1-b242-e4dc7a94c5d4 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] [instance: d1efb756-8e30-4c05-9156-de4ae119ac3c] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:48.440325 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-b775dc7b-5a8d-49e1-b242-e4dc7a94c5d4 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:48.446426 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-b775dc7b-5a8d-49e1-b242-e4dc7a94c5d4 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:48.446426 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-b775dc7b-5a8d-49e1-b242-e4dc7a94c5d4 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:48.446426 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-b775dc7b-5a8d-49e1-b242-e4dc7a94c5d4 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:48.583704 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-b775dc7b-5a8d-49e1-b242-e4dc7a94c5d4 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7277aedb35df448e8b3056f8bc395e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c876091609fe45ba80370a16748cbeb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:54:48.591925 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-b775dc7b-5a8d-49e1-b242-e4dc7a94c5d4 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] 10.222.0.41 "GET /compute/v2.1/servers/d1efb756-8e30-4c05-9156-de4ae119ac3c" status: 200 len: 1759 microversion: 2.1 time: 0.163445 May 26 12:54:48.596280 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 427/850] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:54:48 2022] GET /compute/v2.1/servers/d1efb756-8e30-4c05-9156-de4ae119ac3c => generated 1759 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:54:49.110199 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-cdcf79be-0d2c-4b12-b1e8-e2adaf49ccc4 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:49.110810 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-cdcf79be-0d2c-4b12-b1e8-e2adaf49ccc4 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] [instance: 36055083-9302-436b-b724-512117ae5dfc] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:49.113214 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG dbcounter [-] [124824] Writing DB stats nova_api:SELECT=30 {{(pid=124824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:54:49.118796 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-cdcf79be-0d2c-4b12-b1e8-e2adaf49ccc4 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:49.123025 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-cdcf79be-0d2c-4b12-b1e8-e2adaf49ccc4 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:49.123025 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-cdcf79be-0d2c-4b12-b1e8-e2adaf49ccc4 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:49.123025 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-cdcf79be-0d2c-4b12-b1e8-e2adaf49ccc4 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:49.180941 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-cdcf79be-0d2c-4b12-b1e8-e2adaf49ccc4 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1cdcc03aee2493eb40013a66243cf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a43dd5e9d7841419a87df430827af67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:54:49.188469 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-cdcf79be-0d2c-4b12-b1e8-e2adaf49ccc4 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] 10.222.0.41 "GET /compute/v2.1/servers/36055083-9302-436b-b724-512117ae5dfc" status: 200 len: 1218 microversion: 2.1 time: 0.082114 May 26 12:54:49.189035 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 424/851] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:54:49 2022] GET /compute/v2.1/servers/36055083-9302-436b-b724-512117ae5dfc => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:54:49.609608 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-7eb67ece-d14c-48b4-b17d-5c36361e13ed tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:49.610282 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-7eb67ece-d14c-48b4-b17d-5c36361e13ed tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] [instance: d1efb756-8e30-4c05-9156-de4ae119ac3c] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:49.617521 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-7eb67ece-d14c-48b4-b17d-5c36361e13ed tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:49.618082 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-7eb67ece-d14c-48b4-b17d-5c36361e13ed tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:49.618770 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-7eb67ece-d14c-48b4-b17d-5c36361e13ed tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:49.619200 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-7eb67ece-d14c-48b4-b17d-5c36361e13ed tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:49.765177 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-7eb67ece-d14c-48b4-b17d-5c36361e13ed tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7277aedb35df448e8b3056f8bc395e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c876091609fe45ba80370a16748cbeb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:54:49.773379 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-7eb67ece-d14c-48b4-b17d-5c36361e13ed tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] 10.222.0.41 "GET /compute/v2.1/servers/d1efb756-8e30-4c05-9156-de4ae119ac3c" status: 200 len: 1759 microversion: 2.1 time: 0.167648 May 26 12:54:49.773986 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 428/852] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:54:49 2022] GET /compute/v2.1/servers/d1efb756-8e30-4c05-9156-de4ae119ac3c => generated 1759 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:54:50.205593 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-97963bfd-a7ca-4ec2-8137-0ab88b2e28ea tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:50.206432 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-97963bfd-a7ca-4ec2-8137-0ab88b2e28ea tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] [instance: 36055083-9302-436b-b724-512117ae5dfc] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:50.213494 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-97963bfd-a7ca-4ec2-8137-0ab88b2e28ea tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:50.213968 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-97963bfd-a7ca-4ec2-8137-0ab88b2e28ea tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:50.214741 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-97963bfd-a7ca-4ec2-8137-0ab88b2e28ea tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:50.215179 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-97963bfd-a7ca-4ec2-8137-0ab88b2e28ea tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:50.278815 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-97963bfd-a7ca-4ec2-8137-0ab88b2e28ea tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1cdcc03aee2493eb40013a66243cf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a43dd5e9d7841419a87df430827af67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:54:50.286773 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-97963bfd-a7ca-4ec2-8137-0ab88b2e28ea tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] 10.222.0.41 "GET /compute/v2.1/servers/36055083-9302-436b-b724-512117ae5dfc" status: 200 len: 1266 microversion: 2.1 time: 0.085116 May 26 12:54:50.287334 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 425/853] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:54:50 2022] GET /compute/v2.1/servers/36055083-9302-436b-b724-512117ae5dfc => generated 1266 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:54:50.790393 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-e0f980bc-1620-4f43-a4b8-f7a9d7345ecc tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:50.791262 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-e0f980bc-1620-4f43-a4b8-f7a9d7345ecc tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] [instance: d1efb756-8e30-4c05-9156-de4ae119ac3c] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:50.798560 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-e0f980bc-1620-4f43-a4b8-f7a9d7345ecc tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:50.800897 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-e0f980bc-1620-4f43-a4b8-f7a9d7345ecc tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:50.800897 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-e0f980bc-1620-4f43-a4b8-f7a9d7345ecc tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:50.800897 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-e0f980bc-1620-4f43-a4b8-f7a9d7345ecc tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:50.949063 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-e0f980bc-1620-4f43-a4b8-f7a9d7345ecc tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7277aedb35df448e8b3056f8bc395e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c876091609fe45ba80370a16748cbeb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:54:50.959502 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-e0f980bc-1620-4f43-a4b8-f7a9d7345ecc tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] 10.222.0.41 "GET /compute/v2.1/servers/d1efb756-8e30-4c05-9156-de4ae119ac3c" status: 200 len: 1759 microversion: 2.1 time: 0.170879 May 26 12:54:50.959502 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 429/854] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:54:50 2022] GET /compute/v2.1/servers/d1efb756-8e30-4c05-9156-de4ae119ac3c => generated 1759 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:54:51.303402 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-ec84611e-bb87-473f-ba79-a1e5009a8aaa tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:51.304031 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-ec84611e-bb87-473f-ba79-a1e5009a8aaa tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] [instance: 36055083-9302-436b-b724-512117ae5dfc] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:51.310968 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-ec84611e-bb87-473f-ba79-a1e5009a8aaa tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:51.311407 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-ec84611e-bb87-473f-ba79-a1e5009a8aaa tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:51.312167 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-ec84611e-bb87-473f-ba79-a1e5009a8aaa tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:51.312593 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-ec84611e-bb87-473f-ba79-a1e5009a8aaa tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:51.551971 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-ec84611e-bb87-473f-ba79-a1e5009a8aaa tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1cdcc03aee2493eb40013a66243cf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a43dd5e9d7841419a87df430827af67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:54:51.559343 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-ec84611e-bb87-473f-ba79-a1e5009a8aaa tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] 10.222.0.41 "GET /compute/v2.1/servers/36055083-9302-436b-b724-512117ae5dfc" status: 200 len: 1314 microversion: 2.1 time: 0.260330 May 26 12:54:51.559926 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 426/855] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:54:51 2022] GET /compute/v2.1/servers/36055083-9302-436b-b724-512117ae5dfc => generated 1314 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:54:51.975034 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-a0ec6d0a-07eb-409e-acd0-2d01cee60985 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:51.975678 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-a0ec6d0a-07eb-409e-acd0-2d01cee60985 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] [instance: d1efb756-8e30-4c05-9156-de4ae119ac3c] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:51.982307 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-a0ec6d0a-07eb-409e-acd0-2d01cee60985 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:51.982759 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-a0ec6d0a-07eb-409e-acd0-2d01cee60985 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:51.983527 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-a0ec6d0a-07eb-409e-acd0-2d01cee60985 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:51.983960 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-a0ec6d0a-07eb-409e-acd0-2d01cee60985 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:52.134024 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [req-bfef4a9b-db56-48ad-af75-889ac8263045 req-c707d920-2861-40b1-922c-26668fa7505b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36055083-9302-436b-b724-512117ae5dfc", "tag": "4975fc92-ec68-4b22-8fa2-a1f2be3c6017"}]} {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:54:52.134159 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-a0ec6d0a-07eb-409e-acd0-2d01cee60985 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7277aedb35df448e8b3056f8bc395e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c876091609fe45ba80370a16748cbeb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:54:52.142423 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-a0ec6d0a-07eb-409e-acd0-2d01cee60985 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] 10.222.0.41 "GET /compute/v2.1/servers/d1efb756-8e30-4c05-9156-de4ae119ac3c" status: 200 len: 1759 microversion: 2.1 time: 0.171363 May 26 12:54:52.143508 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 430/856] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:54:51 2022] GET /compute/v2.1/servers/d1efb756-8e30-4c05-9156-de4ae119ac3c => generated 1759 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:54:52.149259 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [req-bfef4a9b-db56-48ad-af75-889ac8263045 req-c707d920-2861-40b1-922c-26668fa7505b service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:52.149728 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [req-bfef4a9b-db56-48ad-af75-889ac8263045 req-c707d920-2861-40b1-922c-26668fa7505b service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:52.165196 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.compute.server_external_events [req-bfef4a9b-db56-48ad-af75-889ac8263045 req-c707d920-2861-40b1-922c-26668fa7505b service nova] Creating event network-changed:4975fc92-ec68-4b22-8fa2-a1f2be3c6017 for instance 36055083-9302-436b-b724-512117ae5dfc on hv-cinder-81571 May 26 12:54:52.170140 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [req-bfef4a9b-db56-48ad-af75-889ac8263045 req-c707d920-2861-40b1-922c-26668fa7505b service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040313 May 26 12:54:52.170749 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 427/857] 10.222.0.41 () {64 vars in 1317 bytes} [Thu May 26 12:54:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:54:52.576268 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-90c57843-2a7f-43ab-821c-007d4c2c4fa5 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:52.576885 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-90c57843-2a7f-43ab-821c-007d4c2c4fa5 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] [instance: 36055083-9302-436b-b724-512117ae5dfc] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:52.582971 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-90c57843-2a7f-43ab-821c-007d4c2c4fa5 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:52.583419 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-90c57843-2a7f-43ab-821c-007d4c2c4fa5 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:52.584185 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-90c57843-2a7f-43ab-821c-007d4c2c4fa5 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:52.584615 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-90c57843-2a7f-43ab-821c-007d4c2c4fa5 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:52.726526 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-90c57843-2a7f-43ab-821c-007d4c2c4fa5 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1cdcc03aee2493eb40013a66243cf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a43dd5e9d7841419a87df430827af67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:54:52.735361 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-90c57843-2a7f-43ab-821c-007d4c2c4fa5 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] 10.222.0.41 "GET /compute/v2.1/servers/36055083-9302-436b-b724-512117ae5dfc" status: 200 len: 1314 microversion: 2.1 time: 0.162853 May 26 12:54:52.735939 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 431/858] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:54:52 2022] GET /compute/v2.1/servers/36055083-9302-436b-b724-512117ae5dfc => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:54:53.161111 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-18f5e03c-5c5d-4964-8423-77218acd8e3c tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:53.161766 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-18f5e03c-5c5d-4964-8423-77218acd8e3c tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] [instance: d1efb756-8e30-4c05-9156-de4ae119ac3c] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:53.168003 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-18f5e03c-5c5d-4964-8423-77218acd8e3c tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:53.168452 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-18f5e03c-5c5d-4964-8423-77218acd8e3c tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:53.169221 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-18f5e03c-5c5d-4964-8423-77218acd8e3c tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:53.169658 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-18f5e03c-5c5d-4964-8423-77218acd8e3c tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:53.316185 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-18f5e03c-5c5d-4964-8423-77218acd8e3c tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7277aedb35df448e8b3056f8bc395e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c876091609fe45ba80370a16748cbeb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:54:53.324149 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-18f5e03c-5c5d-4964-8423-77218acd8e3c tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] 10.222.0.41 "GET /compute/v2.1/servers/d1efb756-8e30-4c05-9156-de4ae119ac3c" status: 200 len: 1759 microversion: 2.1 time: 0.167816 May 26 12:54:53.324718 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 428/859] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:54:53 2022] GET /compute/v2.1/servers/d1efb756-8e30-4c05-9156-de4ae119ac3c => generated 1759 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:54:53.752094 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-46242adb-93b5-4f6c-9b75-0a55cb0d5852 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:53.753269 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-46242adb-93b5-4f6c-9b75-0a55cb0d5852 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] [instance: 36055083-9302-436b-b724-512117ae5dfc] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:53.759904 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-46242adb-93b5-4f6c-9b75-0a55cb0d5852 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:53.760350 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-46242adb-93b5-4f6c-9b75-0a55cb0d5852 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:53.761109 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-46242adb-93b5-4f6c-9b75-0a55cb0d5852 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:53.761542 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-46242adb-93b5-4f6c-9b75-0a55cb0d5852 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:53.886316 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-46242adb-93b5-4f6c-9b75-0a55cb0d5852 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1cdcc03aee2493eb40013a66243cf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a43dd5e9d7841419a87df430827af67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:54:53.893835 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-46242adb-93b5-4f6c-9b75-0a55cb0d5852 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] 10.222.0.41 "GET /compute/v2.1/servers/36055083-9302-436b-b724-512117ae5dfc" status: 200 len: 1314 microversion: 2.1 time: 0.145595 May 26 12:54:53.894893 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 432/860] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:54:53 2022] GET /compute/v2.1/servers/36055083-9302-436b-b724-512117ae5dfc => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:54:54.341727 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-abc37a83-a83c-4619-9b16-fd71382da7e7 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:54.342263 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-abc37a83-a83c-4619-9b16-fd71382da7e7 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] [instance: d1efb756-8e30-4c05-9156-de4ae119ac3c] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:54.349733 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-abc37a83-a83c-4619-9b16-fd71382da7e7 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:54.350181 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-abc37a83-a83c-4619-9b16-fd71382da7e7 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:54.350977 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-abc37a83-a83c-4619-9b16-fd71382da7e7 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:54.351365 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-abc37a83-a83c-4619-9b16-fd71382da7e7 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:54.501307 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-abc37a83-a83c-4619-9b16-fd71382da7e7 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7277aedb35df448e8b3056f8bc395e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c876091609fe45ba80370a16748cbeb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:54:54.510397 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-abc37a83-a83c-4619-9b16-fd71382da7e7 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] 10.222.0.41 "GET /compute/v2.1/servers/d1efb756-8e30-4c05-9156-de4ae119ac3c" status: 200 len: 1759 microversion: 2.1 time: 0.172523 May 26 12:54:54.510989 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 429/861] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:54:54 2022] GET /compute/v2.1/servers/d1efb756-8e30-4c05-9156-de4ae119ac3c => generated 1759 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:54:54.910969 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-31fe4da9-a036-4527-a5fb-880238eaea6f tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:54.911504 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-31fe4da9-a036-4527-a5fb-880238eaea6f tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] [instance: 36055083-9302-436b-b724-512117ae5dfc] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:54.917982 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-31fe4da9-a036-4527-a5fb-880238eaea6f tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:54.918425 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-31fe4da9-a036-4527-a5fb-880238eaea6f tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:54.919214 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-31fe4da9-a036-4527-a5fb-880238eaea6f tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:54.919648 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-31fe4da9-a036-4527-a5fb-880238eaea6f tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:55.048482 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-31fe4da9-a036-4527-a5fb-880238eaea6f tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1cdcc03aee2493eb40013a66243cf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a43dd5e9d7841419a87df430827af67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:54:55.056495 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-31fe4da9-a036-4527-a5fb-880238eaea6f tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] 10.222.0.41 "GET /compute/v2.1/servers/36055083-9302-436b-b724-512117ae5dfc" status: 200 len: 1314 microversion: 2.1 time: 0.149575 May 26 12:54:55.057058 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 433/862] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:54:54 2022] GET /compute/v2.1/servers/36055083-9302-436b-b724-512117ae5dfc => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:54:55.528377 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-8695900e-aa9d-40f7-a9ae-a5352656f668 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:55.528979 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-8695900e-aa9d-40f7-a9ae-a5352656f668 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] [instance: d1efb756-8e30-4c05-9156-de4ae119ac3c] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:55.535873 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-8695900e-aa9d-40f7-a9ae-a5352656f668 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:55.536317 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-8695900e-aa9d-40f7-a9ae-a5352656f668 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:55.537070 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-8695900e-aa9d-40f7-a9ae-a5352656f668 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:55.537503 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-8695900e-aa9d-40f7-a9ae-a5352656f668 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:55.678351 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-8695900e-aa9d-40f7-a9ae-a5352656f668 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7277aedb35df448e8b3056f8bc395e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c876091609fe45ba80370a16748cbeb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:54:55.686423 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-8695900e-aa9d-40f7-a9ae-a5352656f668 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] 10.222.0.41 "GET /compute/v2.1/servers/d1efb756-8e30-4c05-9156-de4ae119ac3c" status: 200 len: 1759 microversion: 2.1 time: 0.161913 May 26 12:54:55.686986 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 430/863] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:54:55 2022] GET /compute/v2.1/servers/d1efb756-8e30-4c05-9156-de4ae119ac3c => generated 1759 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:54:56.073085 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-5be19bb7-7fdd-496c-898d-8c2ac6cc6a92 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:56.073597 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-5be19bb7-7fdd-496c-898d-8c2ac6cc6a92 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] [instance: 36055083-9302-436b-b724-512117ae5dfc] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:56.080993 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-5be19bb7-7fdd-496c-898d-8c2ac6cc6a92 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:56.081469 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-5be19bb7-7fdd-496c-898d-8c2ac6cc6a92 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:56.082284 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-5be19bb7-7fdd-496c-898d-8c2ac6cc6a92 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:56.083312 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-5be19bb7-7fdd-496c-898d-8c2ac6cc6a92 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:56.212624 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-5be19bb7-7fdd-496c-898d-8c2ac6cc6a92 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1cdcc03aee2493eb40013a66243cf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a43dd5e9d7841419a87df430827af67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:54:56.220411 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-5be19bb7-7fdd-496c-898d-8c2ac6cc6a92 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] 10.222.0.41 "GET /compute/v2.1/servers/36055083-9302-436b-b724-512117ae5dfc" status: 200 len: 1314 microversion: 2.1 time: 0.151335 May 26 12:54:56.220995 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 434/864] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:54:56 2022] GET /compute/v2.1/servers/36055083-9302-436b-b724-512117ae5dfc => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:54:56.453223 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [req-ea050b65-86ac-4988-a86c-31764984e153 req-6567b9d7-2cb7-4ca7-8f49-c1ba79cfed3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36055083-9302-436b-b724-512117ae5dfc", "name": "network-vif-plugged", "status": "completed", "tag": "4975fc92-ec68-4b22-8fa2-a1f2be3c6017"}]} {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:54:56.462062 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [req-ea050b65-86ac-4988-a86c-31764984e153 req-6567b9d7-2cb7-4ca7-8f49-c1ba79cfed3b service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:56.462750 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [req-ea050b65-86ac-4988-a86c-31764984e153 req-6567b9d7-2cb7-4ca7-8f49-c1ba79cfed3b service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:56.473861 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.compute.server_external_events [req-ea050b65-86ac-4988-a86c-31764984e153 req-6567b9d7-2cb7-4ca7-8f49-c1ba79cfed3b service nova] Creating event network-vif-plugged:4975fc92-ec68-4b22-8fa2-a1f2be3c6017 for instance 36055083-9302-436b-b724-512117ae5dfc on hv-cinder-81571 May 26 12:54:56.479000 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [req-ea050b65-86ac-4988-a86c-31764984e153 req-6567b9d7-2cb7-4ca7-8f49-c1ba79cfed3b service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029613 May 26 12:54:56.479584 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 431/865] 10.222.0.41 () {64 vars in 1317 bytes} [Thu May 26 12:54:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:54:56.703406 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-1d5ac04e-bf8d-4cdd-8738-eb27d44b1d28 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:56.704012 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-1d5ac04e-bf8d-4cdd-8738-eb27d44b1d28 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] [instance: d1efb756-8e30-4c05-9156-de4ae119ac3c] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:56.709988 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-1d5ac04e-bf8d-4cdd-8738-eb27d44b1d28 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:56.710444 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-1d5ac04e-bf8d-4cdd-8738-eb27d44b1d28 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:56.711190 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-1d5ac04e-bf8d-4cdd-8738-eb27d44b1d28 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:56.711629 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-1d5ac04e-bf8d-4cdd-8738-eb27d44b1d28 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:56.859644 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-1d5ac04e-bf8d-4cdd-8738-eb27d44b1d28 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7277aedb35df448e8b3056f8bc395e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c876091609fe45ba80370a16748cbeb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:54:56.868287 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-1d5ac04e-bf8d-4cdd-8738-eb27d44b1d28 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] 10.222.0.41 "GET /compute/v2.1/servers/d1efb756-8e30-4c05-9156-de4ae119ac3c" status: 200 len: 1762 microversion: 2.1 time: 0.168124 May 26 12:54:56.873780 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 435/866] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:54:56 2022] GET /compute/v2.1/servers/d1efb756-8e30-4c05-9156-de4ae119ac3c => generated 1762 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:54:57.237480 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-f22069e1-ae06-43b9-8f26-55b726566ac1 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:57.238114 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-f22069e1-ae06-43b9-8f26-55b726566ac1 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] [instance: 36055083-9302-436b-b724-512117ae5dfc] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:57.244447 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-f22069e1-ae06-43b9-8f26-55b726566ac1 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:57.244917 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-f22069e1-ae06-43b9-8f26-55b726566ac1 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:57.245842 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-f22069e1-ae06-43b9-8f26-55b726566ac1 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:57.246275 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-f22069e1-ae06-43b9-8f26-55b726566ac1 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:57.376161 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-f22069e1-ae06-43b9-8f26-55b726566ac1 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1cdcc03aee2493eb40013a66243cf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a43dd5e9d7841419a87df430827af67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:54:57.383558 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-f22069e1-ae06-43b9-8f26-55b726566ac1 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] 10.222.0.41 "GET /compute/v2.1/servers/36055083-9302-436b-b724-512117ae5dfc" status: 200 len: 1314 microversion: 2.1 time: 0.150793 May 26 12:54:57.384123 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 432/867] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:54:57 2022] GET /compute/v2.1/servers/36055083-9302-436b-b724-512117ae5dfc => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:54:58.402301 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-94f8d522-8482-497b-ac0f-a7ef3e156719 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:58.402910 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-94f8d522-8482-497b-ac0f-a7ef3e156719 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] [instance: 36055083-9302-436b-b724-512117ae5dfc] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:58.405300 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG dbcounter [-] [124823] Writing DB stats nova_cell0:SELECT=2 {{(pid=124823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:54:58.405983 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG dbcounter [-] [124823] Writing DB stats nova_cell0:SELECT=6 {{(pid=124823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:54:58.410775 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-94f8d522-8482-497b-ac0f-a7ef3e156719 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:58.415166 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-94f8d522-8482-497b-ac0f-a7ef3e156719 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:58.415166 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-94f8d522-8482-497b-ac0f-a7ef3e156719 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:58.415166 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-94f8d522-8482-497b-ac0f-a7ef3e156719 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:58.547145 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-94f8d522-8482-497b-ac0f-a7ef3e156719 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1cdcc03aee2493eb40013a66243cf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a43dd5e9d7841419a87df430827af67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:54:58.555890 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-94f8d522-8482-497b-ac0f-a7ef3e156719 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] 10.222.0.41 "GET /compute/v2.1/servers/36055083-9302-436b-b724-512117ae5dfc" status: 200 len: 1314 microversion: 2.1 time: 0.157362 May 26 12:54:58.556471 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 436/868] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:54:58 2022] GET /compute/v2.1/servers/36055083-9302-436b-b724-512117ae5dfc => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:54:59.572305 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-76e59686-46fa-4768-acc8-6eef14158465 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:54:59.572920 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-76e59686-46fa-4768-acc8-6eef14158465 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] [instance: 36055083-9302-436b-b724-512117ae5dfc] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:54:59.574977 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG dbcounter [-] [124824] Writing DB stats nova_cell0:SELECT=2 {{(pid=124824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:54:59.580307 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-76e59686-46fa-4768-acc8-6eef14158465 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:59.585561 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-76e59686-46fa-4768-acc8-6eef14158465 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:59.585561 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-76e59686-46fa-4768-acc8-6eef14158465 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:54:59.585561 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-76e59686-46fa-4768-acc8-6eef14158465 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:54:59.709084 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-76e59686-46fa-4768-acc8-6eef14158465 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1cdcc03aee2493eb40013a66243cf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a43dd5e9d7841419a87df430827af67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:54:59.716617 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-76e59686-46fa-4768-acc8-6eef14158465 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] 10.222.0.41 "GET /compute/v2.1/servers/36055083-9302-436b-b724-512117ae5dfc" status: 200 len: 1498 microversion: 2.1 time: 0.148201 May 26 12:54:59.717221 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 433/869] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:54:59 2022] GET /compute/v2.1/servers/36055083-9302-436b-b724-512117ae5dfc => generated 1498 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:55:00.510614 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-e1d2de47-f2e4-45e9-9f43-85fedaa91c72 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:00.511230 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-e1d2de47-f2e4-45e9-9f43-85fedaa91c72 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] [instance: 36055083-9302-436b-b724-512117ae5dfc] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:00.517766 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-e1d2de47-f2e4-45e9-9f43-85fedaa91c72 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:00.518321 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-e1d2de47-f2e4-45e9-9f43-85fedaa91c72 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:00.519090 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-e1d2de47-f2e4-45e9-9f43-85fedaa91c72 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:00.519524 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-e1d2de47-f2e4-45e9-9f43-85fedaa91c72 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:00.531576 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-8d0e2782-5f05-4968-a488-de6d1de6a657 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:00.532071 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-8d0e2782-5f05-4968-a488-de6d1de6a657 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] [instance: 7f3fde81-3f47-4590-ad2e-330bd31ed1f7] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:00.538586 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-8d0e2782-5f05-4968-a488-de6d1de6a657 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:00.539033 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-8d0e2782-5f05-4968-a488-de6d1de6a657 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:00.539791 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-8d0e2782-5f05-4968-a488-de6d1de6a657 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:00.540220 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-8d0e2782-5f05-4968-a488-de6d1de6a657 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:00.545081 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-e1d2de47-f2e4-45e9-9f43-85fedaa91c72 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] [instance: 36055083-9302-436b-b724-512117ae5dfc] Going to try to terminate instance {{(pid=124823) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 12:55:00.559527 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG dbcounter [-] [124823] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:55:00.564967 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-8d0e2782-5f05-4968-a488-de6d1de6a657 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] 10.222.0.41 "GET /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7/ips" status: 200 len: 145 microversion: 2.1 time: 0.037167 May 26 12:55:00.570009 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 434/870] 10.222.0.41 () {58 vars in 1247 bytes} [Thu May 26 12:55:00 2022] GET /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7/ips => generated 145 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:55:00.909082 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-e1d2de47-f2e4-45e9-9f43-85fedaa91c72 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] 10.222.0.41 "DELETE /compute/v2.1/servers/36055083-9302-436b-b724-512117ae5dfc" status: 204 len: 0 microversion: 2.1 time: 0.402107 May 26 12:55:00.909959 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 437/871] 10.222.0.41 () {58 vars in 1238 bytes} [Thu May 26 12:55:00 2022] DELETE /compute/v2.1/servers/36055083-9302-436b-b724-512117ae5dfc => generated 0 bytes in 404 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 12:55:00.925100 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-4fdd21cb-9238-4bb2-9b87-d8a08f4bc75f tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:00.925739 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-4fdd21cb-9238-4bb2-9b87-d8a08f4bc75f tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] [instance: 36055083-9302-436b-b724-512117ae5dfc] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:00.932251 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-4fdd21cb-9238-4bb2-9b87-d8a08f4bc75f tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:00.932700 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-4fdd21cb-9238-4bb2-9b87-d8a08f4bc75f tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:00.933464 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-4fdd21cb-9238-4bb2-9b87-d8a08f4bc75f tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:00.933922 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-4fdd21cb-9238-4bb2-9b87-d8a08f4bc75f tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:01.065829 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-4fdd21cb-9238-4bb2-9b87-d8a08f4bc75f tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1cdcc03aee2493eb40013a66243cf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a43dd5e9d7841419a87df430827af67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:01.073800 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-4fdd21cb-9238-4bb2-9b87-d8a08f4bc75f tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] 10.222.0.41 "GET /compute/v2.1/servers/36055083-9302-436b-b724-512117ae5dfc" status: 200 len: 1504 microversion: 2.1 time: 0.152423 May 26 12:55:01.074387 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 435/872] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:55:00 2022] GET /compute/v2.1/servers/36055083-9302-436b-b724-512117ae5dfc => generated 1504 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:55:02.092094 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-48f1f470-b39b-4ad3-b8b7-41f82a2cd72d tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:02.092793 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-48f1f470-b39b-4ad3-b8b7-41f82a2cd72d tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] [instance: 36055083-9302-436b-b724-512117ae5dfc] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:02.100145 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-48f1f470-b39b-4ad3-b8b7-41f82a2cd72d tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:02.100617 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-48f1f470-b39b-4ad3-b8b7-41f82a2cd72d tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:02.101376 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-48f1f470-b39b-4ad3-b8b7-41f82a2cd72d tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:02.101849 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-48f1f470-b39b-4ad3-b8b7-41f82a2cd72d tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:02.234177 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-48f1f470-b39b-4ad3-b8b7-41f82a2cd72d tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1cdcc03aee2493eb40013a66243cf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a43dd5e9d7841419a87df430827af67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:02.242486 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-48f1f470-b39b-4ad3-b8b7-41f82a2cd72d tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] 10.222.0.41 "GET /compute/v2.1/servers/36055083-9302-436b-b724-512117ae5dfc" status: 200 len: 1504 microversion: 2.1 time: 0.154914 May 26 12:55:02.243088 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 438/873] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:55:02 2022] GET /compute/v2.1/servers/36055083-9302-436b-b724-512117ae5dfc => generated 1504 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:55:03.087214 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [req-277af5e2-d223-435b-abe1-f3e2bf4df343 req-b56f4826-d8cd-4fc4-badd-2f20a21c0d5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36055083-9302-436b-b724-512117ae5dfc", "name": "network-vif-deleted", "tag": "4975fc92-ec68-4b22-8fa2-a1f2be3c6017"}]} {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:55:03.096769 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [req-277af5e2-d223-435b-abe1-f3e2bf4df343 req-b56f4826-d8cd-4fc4-badd-2f20a21c0d5e service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:03.102346 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [req-277af5e2-d223-435b-abe1-f3e2bf4df343 req-b56f4826-d8cd-4fc4-badd-2f20a21c0d5e service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:03.109157 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.compute.server_external_events [req-277af5e2-d223-435b-abe1-f3e2bf4df343 req-b56f4826-d8cd-4fc4-badd-2f20a21c0d5e service nova] Creating event network-vif-deleted:4975fc92-ec68-4b22-8fa2-a1f2be3c6017 for instance 36055083-9302-436b-b724-512117ae5dfc on hv-cinder-81571 May 26 12:55:03.114326 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [req-277af5e2-d223-435b-abe1-f3e2bf4df343 req-b56f4826-d8cd-4fc4-badd-2f20a21c0d5e service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031289 May 26 12:55:03.114917 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 436/874] 10.222.0.41 () {64 vars in 1317 bytes} [Thu May 26 12:55:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:55:03.260555 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-93009317-9d20-4a72-9dd5-8a77a97a623d tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:03.261086 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-93009317-9d20-4a72-9dd5-8a77a97a623d tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] [instance: 36055083-9302-436b-b724-512117ae5dfc] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:03.269021 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-93009317-9d20-4a72-9dd5-8a77a97a623d tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:03.269469 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-93009317-9d20-4a72-9dd5-8a77a97a623d tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:03.270849 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-93009317-9d20-4a72-9dd5-8a77a97a623d tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:03.271280 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-93009317-9d20-4a72-9dd5-8a77a97a623d tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:03.335195 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-93009317-9d20-4a72-9dd5-8a77a97a623d tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1cdcc03aee2493eb40013a66243cf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a43dd5e9d7841419a87df430827af67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:03.343578 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-93009317-9d20-4a72-9dd5-8a77a97a623d tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] 10.222.0.41 "GET /compute/v2.1/servers/36055083-9302-436b-b724-512117ae5dfc" status: 200 len: 1299 microversion: 2.1 time: 0.087524 May 26 12:55:03.344169 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 439/875] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:55:03 2022] GET /compute/v2.1/servers/36055083-9302-436b-b724-512117ae5dfc => generated 1299 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:55:03.430920 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-0fc0c4eb-dae1-4030-befa-08bffb328542 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "459dc9e5-0f2c-4bc1-ab8f-c3acb146695e"}} {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:55:03.432061 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-0fc0c4eb-dae1-4030-befa-08bffb328542 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] [instance: 7f3fde81-3f47-4590-ad2e-330bd31ed1f7] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:03.438449 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-0fc0c4eb-dae1-4030-befa-08bffb328542 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:03.438897 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-0fc0c4eb-dae1-4030-befa-08bffb328542 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:03.439663 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-0fc0c4eb-dae1-4030-befa-08bffb328542 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:03.440094 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-0fc0c4eb-dae1-4030-befa-08bffb328542 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:03.838346 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG dbcounter [-] [124824] Writing DB stats nova_cell1:SELECT=100 {{(pid=124824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:55:04.363406 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-1bb88fb0-36e6-42e5-8404-7ac91a0a42e9 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:04.364032 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-1bb88fb0-36e6-42e5-8404-7ac91a0a42e9 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] [instance: 36055083-9302-436b-b724-512117ae5dfc] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:04.370956 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-1bb88fb0-36e6-42e5-8404-7ac91a0a42e9 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:04.371414 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-1bb88fb0-36e6-42e5-8404-7ac91a0a42e9 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:04.372195 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-1bb88fb0-36e6-42e5-8404-7ac91a0a42e9 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:04.372633 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-1bb88fb0-36e6-42e5-8404-7ac91a0a42e9 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:04.387402 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.wsgi [None req-1bb88fb0-36e6-42e5-8404-7ac91a0a42e9 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] HTTP exception thrown: Instance 36055083-9302-436b-b724-512117ae5dfc could not be found. May 26 12:55:04.391330 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-1bb88fb0-36e6-42e5-8404-7ac91a0a42e9 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Request method failure captured: May 26 12:55:04.391330 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: request: GET /compute/v2.1/servers/36055083-9302-436b-b724-512117ae5dfc HTTP/1.1 May 26 12:55:04.391330 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Accept: application/json May 26 12:55:04.391330 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Accept-Encoding: identity May 26 12:55:04.391330 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Connection: close May 26 12:55:04.391330 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Content-Length: 0 May 26 12:55:04.391330 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Content-Type: application/json May 26 12:55:04.391330 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Host: 10.222.0.41 May 26 12:55:04.391330 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Openstack-System-Scope: None May 26 12:55:04.391330 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: User-Agent: python-urllib3/1.26.9 May 26 12:55:04.391330 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Auth-Token: gAAAAABij3iVZg6UqUMyFK4KNPGo6f5DmkjrcinlaO2pv82CdE0fkJJhBAEBVLG3dt4GTYRBhcv-BXQLCjGkAzLctJsxix3CWMg-KVfO5tov2ze5Wzx3mUq5Wr8RiCmMekZAfNSZD2uBUbmYWXh3sb6NTbOanGcvGN7K7N9CMeDOI5GFEZ2gxf0 May 26 12:55:04.391330 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Domain-Id: None May 26 12:55:04.391330 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Domain-Name: None May 26 12:55:04.391330 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Identity-Status: Confirmed May 26 12:55:04.391330 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Is-Admin-Project: True May 26 12:55:04.391330 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Project-Domain-Id: default May 26 12:55:04.391330 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Project-Domain-Name: Default May 26 12:55:04.391330 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Project-Id: 6a43dd5e9d7841419a87df430827af67 May 26 12:55:04.391330 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Project-Name: tempest-VolumesActionsTest-482744866 May 26 12:55:04.391330 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Role: member,reader May 26 12:55:04.391330 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Roles: member,reader May 26 12:55:04.393070 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/6a43dd5e9d7841419a87df430827af67"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/6a43dd5e9d7841419a87df430827af67"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/6a43dd5e9d7841419a87df430827af67"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_6a43dd5e9d7841419a87df430827af67", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 26 12:55:04.393070 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Tenant: tempest-VolumesActionsTest-482744866 May 26 12:55:04.393070 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Tenant-Id: 6a43dd5e9d7841419a87df430827af67 May 26 12:55:04.393070 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Tenant-Name: tempest-VolumesActionsTest-482744866 May 26 12:55:04.393070 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User: tempest-VolumesActionsTest-482744866-project May 26 12:55:04.393070 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User-Domain-Id: default May 26 12:55:04.393070 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User-Domain-Name: Default May 26 12:55:04.393070 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User-Id: f1cdcc03aee2493eb40013a66243cf38 May 26 12:55:04.393070 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User-Name: tempest-VolumesActionsTest-482744866-project May 26 12:55:04.393070 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: method: > May 26 12:55:04.393070 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: exception: Instance 36055083-9302-436b-b724-512117ae5dfc could not be found. May 26 12:55:04.393070 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: action_args: {'id': '36055083-9302-436b-b724-512117ae5dfc'} May 26 12:55:04.393070 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:55:04.394107 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:55:04.394107 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:55:04.394107 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:55:04.394107 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:55:04.394107 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:55:04.394107 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:55:04.394107 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:55:04.394107 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:55:04.394107 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:55:04.394107 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36055083-9302-436b-b724-512117ae5dfc could not be found. May 26 12:55:04.394107 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:55:04.394107 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:55:04.394107 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:55:04.394107 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:55:04.394107 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:55:04.394107 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:55:04.394107 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:55:04.394107 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:55:04.394107 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:55:04.394107 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:55:04.396383 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 12:55:04.396383 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 12:55:04.396383 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:55:04.396383 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:55:04.396383 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:55:04.396383 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:55:04.396383 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36055083-9302-436b-b724-512117ae5dfc could not be found. May 26 12:55:04.396383 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:55:04.396383 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:55:04.396383 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:55:04.396383 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:55:04.396383 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:55:04.396383 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:55:04.396383 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:55:04.396383 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:55:04.396383 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36055083-9302-436b-b724-512117ae5dfc could not be found. May 26 12:55:04.396383 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:55:04.397912 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-1bb88fb0-36e6-42e5-8404-7ac91a0a42e9 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Returning 404 to user: Instance 36055083-9302-436b-b724-512117ae5dfc could not be found. {{(pid=124823) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:55:04.397912 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-1bb88fb0-36e6-42e5-8404-7ac91a0a42e9 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] 10.222.0.41 "GET /compute/v2.1/servers/36055083-9302-436b-b724-512117ae5dfc" status: 404 len: 111 microversion: 2.1 time: 0.031074 May 26 12:55:04.397912 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 440/876] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:55:04 2022] GET /compute/v2.1/servers/36055083-9302-436b-b724-512117ae5dfc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 12:55:04.437824 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-7919c462-cbe0-4e09-a3a3-d72cce5c0f72 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1083131961", "imageRef": "6df25342-b071-489b-a7c1-3089fa19af6d", "flavorRef": "452", "networks": [{"uuid": "1dd72085-b5d2-4570-91e3-b99c8ca7e205"}]}} {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:55:04.472837 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-0fc0c4eb-dae1-4030-befa-08bffb328542 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] 10.222.0.41 "POST /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.046756 May 26 12:55:04.473461 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 437/877] 10.222.0.41 () {60 vars in 1322 bytes} [Thu May 26 12:55:03 2022] POST /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7/os-volume_attachments => generated 194 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:55:04.495612 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.network.neutron [None req-7919c462-cbe0-4e09-a3a3-d72cce5c0f72 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] validate_networks() for [('1dd72085-b5d2-4570-91e3-b99c8ca7e205', None, None, None, None, None)] {{(pid=124823) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 12:55:04.866096 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.virt.hardware [None req-7919c462-cbe0-4e09-a3a3-d72cce5c0f72 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Flavor limits 0:0:0 {{(pid=124823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 12:55:04.866520 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.virt.hardware [None req-7919c462-cbe0-4e09-a3a3-d72cce5c0f72 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Image limits 0:0:0 {{(pid=124823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 12:55:04.866996 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.virt.hardware [None req-7919c462-cbe0-4e09-a3a3-d72cce5c0f72 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Flavor pref 0:0:0 {{(pid=124823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 12:55:04.867445 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.virt.hardware [None req-7919c462-cbe0-4e09-a3a3-d72cce5c0f72 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Image pref 0:0:0 {{(pid=124823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 12:55:04.867864 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.virt.hardware [None req-7919c462-cbe0-4e09-a3a3-d72cce5c0f72 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 12:55:04.877329 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-7919c462-cbe0-4e09-a3a3-d72cce5c0f72 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:04.877823 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-7919c462-cbe0-4e09-a3a3-d72cce5c0f72 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:04.878641 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-7919c462-cbe0-4e09-a3a3-d72cce5c0f72 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:04.879057 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-7919c462-cbe0-4e09-a3a3-d72cce5c0f72 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:04.896747 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.quota [None req-7919c462-cbe0-4e09-a3a3-d72cce5c0f72 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Getting quotas for project 6a43dd5e9d7841419a87df430827af67. Resources: {'instances', 'ram', 'cores'} {{(pid=124823) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:55:04.900911 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.quota [None req-7919c462-cbe0-4e09-a3a3-d72cce5c0f72 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Getting quotas for user f1cdcc03aee2493eb40013a66243cf38 and project 6a43dd5e9d7841419a87df430827af67. Resources: {'instances', 'ram', 'cores'} {{(pid=124823) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:55:04.912187 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-7919c462-cbe0-4e09-a3a3-d72cce5c0f72 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Going to run 1 instances... {{(pid=124823) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 12:55:04.914546 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-7919c462-cbe0-4e09-a3a3-d72cce5c0f72 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] [instance: fbbae31b-cdc9-40b7-b71e-df3a83a3e801] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6df25342-b071-489b-a7c1-3089fa19af6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124823) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 12:55:05.026473 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-7919c462-cbe0-4e09-a3a3-d72cce5c0f72 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.592506 May 26 12:55:05.027135 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 441/878] 10.222.0.41 () {60 vars in 1146 bytes} [Thu May 26 12:55:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 594 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 12:55:05.040357 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-90ce57d5-ead4-4194-8dbf-d5e3dd623632 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:05.041048 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-90ce57d5-ead4-4194-8dbf-d5e3dd623632 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] [instance: fbbae31b-cdc9-40b7-b71e-df3a83a3e801] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:05.100925 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-90ce57d5-ead4-4194-8dbf-d5e3dd623632 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1cdcc03aee2493eb40013a66243cf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a43dd5e9d7841419a87df430827af67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:05.107781 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-90ce57d5-ead4-4194-8dbf-d5e3dd623632 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] 10.222.0.41 "GET /compute/v2.1/servers/fbbae31b-cdc9-40b7-b71e-df3a83a3e801" status: 200 len: 1214 microversion: 2.1 time: 0.073666 May 26 12:55:05.108348 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 438/879] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:55:05 2022] GET /compute/v2.1/servers/fbbae31b-cdc9-40b7-b71e-df3a83a3e801 => generated 1214 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:55:06.125339 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-5c6a0032-55e8-4448-95fb-2a618a61883c tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:06.126010 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-5c6a0032-55e8-4448-95fb-2a618a61883c tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] [instance: fbbae31b-cdc9-40b7-b71e-df3a83a3e801] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:06.134028 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-5c6a0032-55e8-4448-95fb-2a618a61883c tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:06.134610 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-5c6a0032-55e8-4448-95fb-2a618a61883c tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:06.135388 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-5c6a0032-55e8-4448-95fb-2a618a61883c tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:06.135831 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-5c6a0032-55e8-4448-95fb-2a618a61883c tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:06.199658 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-5c6a0032-55e8-4448-95fb-2a618a61883c tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1cdcc03aee2493eb40013a66243cf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a43dd5e9d7841419a87df430827af67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:06.207172 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-5c6a0032-55e8-4448-95fb-2a618a61883c tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] 10.222.0.41 "GET /compute/v2.1/servers/fbbae31b-cdc9-40b7-b71e-df3a83a3e801" status: 200 len: 1218 microversion: 2.1 time: 0.086408 May 26 12:55:06.207735 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 442/880] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:55:06 2022] GET /compute/v2.1/servers/fbbae31b-cdc9-40b7-b71e-df3a83a3e801 => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:55:07.224630 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-b3c7f8b7-bff3-4be3-b326-07daf17e4f43 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:07.225279 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-b3c7f8b7-bff3-4be3-b326-07daf17e4f43 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] [instance: fbbae31b-cdc9-40b7-b71e-df3a83a3e801] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:07.232958 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-b3c7f8b7-bff3-4be3-b326-07daf17e4f43 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:07.233407 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-b3c7f8b7-bff3-4be3-b326-07daf17e4f43 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:07.234281 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-b3c7f8b7-bff3-4be3-b326-07daf17e4f43 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:07.234717 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-b3c7f8b7-bff3-4be3-b326-07daf17e4f43 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:07.312651 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-b3c7f8b7-bff3-4be3-b326-07daf17e4f43 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1cdcc03aee2493eb40013a66243cf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a43dd5e9d7841419a87df430827af67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:07.321810 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-b3c7f8b7-bff3-4be3-b326-07daf17e4f43 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] 10.222.0.41 "GET /compute/v2.1/servers/fbbae31b-cdc9-40b7-b71e-df3a83a3e801" status: 200 len: 1274 microversion: 2.1 time: 0.100933 May 26 12:55:07.322404 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 439/881] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:55:07 2022] GET /compute/v2.1/servers/fbbae31b-cdc9-40b7-b71e-df3a83a3e801 => generated 1274 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:55:08.339328 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-776c22fc-0acc-41da-89f9-578a4357027a tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:08.340034 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-776c22fc-0acc-41da-89f9-578a4357027a tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] [instance: fbbae31b-cdc9-40b7-b71e-df3a83a3e801] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:08.346808 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-776c22fc-0acc-41da-89f9-578a4357027a tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:08.347324 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-776c22fc-0acc-41da-89f9-578a4357027a tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:08.348826 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-776c22fc-0acc-41da-89f9-578a4357027a tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:08.349270 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-776c22fc-0acc-41da-89f9-578a4357027a tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:08.477740 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-776c22fc-0acc-41da-89f9-578a4357027a tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1cdcc03aee2493eb40013a66243cf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a43dd5e9d7841419a87df430827af67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:08.485077 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-776c22fc-0acc-41da-89f9-578a4357027a tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] 10.222.0.41 "GET /compute/v2.1/servers/fbbae31b-cdc9-40b7-b71e-df3a83a3e801" status: 200 len: 1314 microversion: 2.1 time: 0.149708 May 26 12:55:08.485639 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 443/882] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:55:08 2022] GET /compute/v2.1/servers/fbbae31b-cdc9-40b7-b71e-df3a83a3e801 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:55:08.875466 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [req-98ccb665-f8bd-4740-97c8-6ae33be58827 req-7791e4c6-c115-4cd2-b8e9-3063bbb24630 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbbae31b-cdc9-40b7-b71e-df3a83a3e801", "tag": "d0e3d57f-d53e-482b-be49-8e6c8d1121c4"}]} {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:55:08.884869 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [req-98ccb665-f8bd-4740-97c8-6ae33be58827 req-7791e4c6-c115-4cd2-b8e9-3063bbb24630 service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:08.885309 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [req-98ccb665-f8bd-4740-97c8-6ae33be58827 req-7791e4c6-c115-4cd2-b8e9-3063bbb24630 service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:08.902339 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.compute.server_external_events [req-98ccb665-f8bd-4740-97c8-6ae33be58827 req-7791e4c6-c115-4cd2-b8e9-3063bbb24630 service nova] Creating event network-changed:d0e3d57f-d53e-482b-be49-8e6c8d1121c4 for instance fbbae31b-cdc9-40b7-b71e-df3a83a3e801 on hv-cinder-81571 May 26 12:55:08.909007 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [req-98ccb665-f8bd-4740-97c8-6ae33be58827 req-7791e4c6-c115-4cd2-b8e9-3063bbb24630 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037153 May 26 12:55:08.909630 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 440/883] 10.222.0.41 () {64 vars in 1317 bytes} [Thu May 26 12:55:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:55:09.505528 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-5f877b97-7cbb-4b87-b2bf-e716b6edf8ab tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:09.518019 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-5f877b97-7cbb-4b87-b2bf-e716b6edf8ab tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] [instance: fbbae31b-cdc9-40b7-b71e-df3a83a3e801] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:09.523230 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG dbcounter [-] [124823] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=124823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:55:09.533940 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-5f877b97-7cbb-4b87-b2bf-e716b6edf8ab tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:09.534684 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-5f877b97-7cbb-4b87-b2bf-e716b6edf8ab tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:09.536903 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-5f877b97-7cbb-4b87-b2bf-e716b6edf8ab tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:09.537970 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-5f877b97-7cbb-4b87-b2bf-e716b6edf8ab tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:09.854725 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-5f877b97-7cbb-4b87-b2bf-e716b6edf8ab tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1cdcc03aee2493eb40013a66243cf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a43dd5e9d7841419a87df430827af67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:09.867121 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-5f877b97-7cbb-4b87-b2bf-e716b6edf8ab tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] 10.222.0.41 "GET /compute/v2.1/servers/fbbae31b-cdc9-40b7-b71e-df3a83a3e801" status: 200 len: 1314 microversion: 2.1 time: 0.368597 May 26 12:55:09.867859 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 444/884] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:55:09 2022] GET /compute/v2.1/servers/fbbae31b-cdc9-40b7-b71e-df3a83a3e801 => generated 1314 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:55:10.894611 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-191932d4-495c-430f-8d2e-c194722010ef tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:10.895229 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-191932d4-495c-430f-8d2e-c194722010ef tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] [instance: fbbae31b-cdc9-40b7-b71e-df3a83a3e801] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:10.902290 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-191932d4-495c-430f-8d2e-c194722010ef tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:10.902735 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-191932d4-495c-430f-8d2e-c194722010ef tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:10.903511 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-191932d4-495c-430f-8d2e-c194722010ef tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:10.903941 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-191932d4-495c-430f-8d2e-c194722010ef tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:11.035043 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-191932d4-495c-430f-8d2e-c194722010ef tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1cdcc03aee2493eb40013a66243cf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a43dd5e9d7841419a87df430827af67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:11.043329 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-191932d4-495c-430f-8d2e-c194722010ef tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] 10.222.0.41 "GET /compute/v2.1/servers/fbbae31b-cdc9-40b7-b71e-df3a83a3e801" status: 200 len: 1314 microversion: 2.1 time: 0.152832 May 26 12:55:11.043909 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 441/885] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:55:10 2022] GET /compute/v2.1/servers/fbbae31b-cdc9-40b7-b71e-df3a83a3e801 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:55:12.060690 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-d2a5df6a-0e70-45e5-8bab-6c6f096f0c7f tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:12.061289 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-d2a5df6a-0e70-45e5-8bab-6c6f096f0c7f tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] [instance: fbbae31b-cdc9-40b7-b71e-df3a83a3e801] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:12.067969 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-d2a5df6a-0e70-45e5-8bab-6c6f096f0c7f tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:12.068442 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-d2a5df6a-0e70-45e5-8bab-6c6f096f0c7f tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:12.069193 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-d2a5df6a-0e70-45e5-8bab-6c6f096f0c7f tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:12.069629 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-d2a5df6a-0e70-45e5-8bab-6c6f096f0c7f tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:12.202527 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-d2a5df6a-0e70-45e5-8bab-6c6f096f0c7f tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1cdcc03aee2493eb40013a66243cf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a43dd5e9d7841419a87df430827af67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:12.210666 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-d2a5df6a-0e70-45e5-8bab-6c6f096f0c7f tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] 10.222.0.41 "GET /compute/v2.1/servers/fbbae31b-cdc9-40b7-b71e-df3a83a3e801" status: 200 len: 1314 microversion: 2.1 time: 0.153811 May 26 12:55:12.212119 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 445/886] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:55:12 2022] GET /compute/v2.1/servers/fbbae31b-cdc9-40b7-b71e-df3a83a3e801 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:55:13.059752 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-d026b6df-c660-4734-87ee-20040e8f22f4 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:55:13.067693 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-d026b6df-c660-4734-87ee-20040e8f22f4 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:13.068136 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-d026b6df-c660-4734-87ee-20040e8f22f4 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:13.132661 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-d026b6df-c660-4734-87ee-20040e8f22f4 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] [instance: 7f3fde81-3f47-4590-ad2e-330bd31ed1f7] Going to try to stop instance {{(pid=124824) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 26 12:55:13.229489 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-fa83053e-9406-42fb-a763-3ed1fe935bcf tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:13.230136 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-fa83053e-9406-42fb-a763-3ed1fe935bcf tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] [instance: fbbae31b-cdc9-40b7-b71e-df3a83a3e801] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:13.236890 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-fa83053e-9406-42fb-a763-3ed1fe935bcf tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:13.237328 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-fa83053e-9406-42fb-a763-3ed1fe935bcf tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:13.238122 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-fa83053e-9406-42fb-a763-3ed1fe935bcf tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:13.239227 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-fa83053e-9406-42fb-a763-3ed1fe935bcf tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:13.379211 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-fa83053e-9406-42fb-a763-3ed1fe935bcf tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1cdcc03aee2493eb40013a66243cf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a43dd5e9d7841419a87df430827af67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:13.382239 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-d026b6df-c660-4734-87ee-20040e8f22f4 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] 10.222.0.41 "POST /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7/action" status: 202 len: 0 microversion: 2.1 time: 0.326717 May 26 12:55:13.386198 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 442/887] 10.222.0.41 () {60 vars in 1277 bytes} [Thu May 26 12:55:13 2022] POST /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7/action => generated 0 bytes in 328 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 12:55:13.389541 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-fa83053e-9406-42fb-a763-3ed1fe935bcf tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] 10.222.0.41 "GET /compute/v2.1/servers/fbbae31b-cdc9-40b7-b71e-df3a83a3e801" status: 200 len: 1314 microversion: 2.1 time: 0.164057 May 26 12:55:13.398973 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 446/888] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:55:13 2022] GET /compute/v2.1/servers/fbbae31b-cdc9-40b7-b71e-df3a83a3e801 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:55:13.399214 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-ce2ae711-cae2-422b-8b80-0873e310a608 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:13.399214 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-ce2ae711-cae2-422b-8b80-0873e310a608 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] [instance: 7f3fde81-3f47-4590-ad2e-330bd31ed1f7] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:13.403957 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-ce2ae711-cae2-422b-8b80-0873e310a608 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:13.403957 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-ce2ae711-cae2-422b-8b80-0873e310a608 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:13.403957 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-ce2ae711-cae2-422b-8b80-0873e310a608 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:13.403957 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-ce2ae711-cae2-422b-8b80-0873e310a608 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:13.566561 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-ce2ae711-cae2-422b-8b80-0873e310a608 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa52505a079041efbbf14fb04da7ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe580a28eae4195be1491ac29d373a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:13.574918 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-ce2ae711-cae2-422b-8b80-0873e310a608 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] 10.222.0.41 "GET /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7" status: 200 len: 1724 microversion: 2.1 time: 0.187453 May 26 12:55:13.575506 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 443/889] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:55:13 2022] GET /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7 => generated 1724 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:55:14.407204 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-f03b7ec5-dc78-4c16-926a-2e3295db0742 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:14.407815 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-f03b7ec5-dc78-4c16-926a-2e3295db0742 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] [instance: fbbae31b-cdc9-40b7-b71e-df3a83a3e801] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:14.415338 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-f03b7ec5-dc78-4c16-926a-2e3295db0742 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:14.416133 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-f03b7ec5-dc78-4c16-926a-2e3295db0742 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:14.417355 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-f03b7ec5-dc78-4c16-926a-2e3295db0742 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:14.417355 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-f03b7ec5-dc78-4c16-926a-2e3295db0742 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:14.537743 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [req-693761ed-79d5-440c-aace-705cf48b8301 req-b084f779-ed4f-4be2-9c65-7f63506ee5b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbbae31b-cdc9-40b7-b71e-df3a83a3e801", "name": "network-vif-plugged", "status": "completed", "tag": "d0e3d57f-d53e-482b-be49-8e6c8d1121c4"}]} {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:55:14.548156 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [req-693761ed-79d5-440c-aace-705cf48b8301 req-b084f779-ed4f-4be2-9c65-7f63506ee5b6 service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:14.548598 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [req-693761ed-79d5-440c-aace-705cf48b8301 req-b084f779-ed4f-4be2-9c65-7f63506ee5b6 service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:14.562113 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.compute.server_external_events [req-693761ed-79d5-440c-aace-705cf48b8301 req-b084f779-ed4f-4be2-9c65-7f63506ee5b6 service nova] Creating event network-vif-plugged:d0e3d57f-d53e-482b-be49-8e6c8d1121c4 for instance fbbae31b-cdc9-40b7-b71e-df3a83a3e801 on hv-cinder-81571 May 26 12:55:14.565064 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-f03b7ec5-dc78-4c16-926a-2e3295db0742 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1cdcc03aee2493eb40013a66243cf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a43dd5e9d7841419a87df430827af67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:14.567633 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [req-693761ed-79d5-440c-aace-705cf48b8301 req-b084f779-ed4f-4be2-9c65-7f63506ee5b6 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035068 May 26 12:55:14.568315 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 444/890] 10.222.0.41 () {64 vars in 1317 bytes} [Thu May 26 12:55:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:55:14.574754 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-f03b7ec5-dc78-4c16-926a-2e3295db0742 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] 10.222.0.41 "GET /compute/v2.1/servers/fbbae31b-cdc9-40b7-b71e-df3a83a3e801" status: 200 len: 1314 microversion: 2.1 time: 0.171643 May 26 12:55:14.575342 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 447/891] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:55:14 2022] GET /compute/v2.1/servers/fbbae31b-cdc9-40b7-b71e-df3a83a3e801 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:55:14.594546 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-1fb2567e-5343-40fe-a7c4-010362bd188f tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:14.595531 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-1fb2567e-5343-40fe-a7c4-010362bd188f tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] [instance: 7f3fde81-3f47-4590-ad2e-330bd31ed1f7] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:14.603360 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-1fb2567e-5343-40fe-a7c4-010362bd188f tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:14.603891 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-1fb2567e-5343-40fe-a7c4-010362bd188f tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:14.611456 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-1fb2567e-5343-40fe-a7c4-010362bd188f tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:14.611456 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-1fb2567e-5343-40fe-a7c4-010362bd188f tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:14.777072 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-1fb2567e-5343-40fe-a7c4-010362bd188f tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa52505a079041efbbf14fb04da7ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe580a28eae4195be1491ac29d373a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:14.785867 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-1fb2567e-5343-40fe-a7c4-010362bd188f tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] 10.222.0.41 "GET /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7" status: 200 len: 1724 microversion: 2.1 time: 0.195434 May 26 12:55:14.786457 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 445/892] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:55:14 2022] GET /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7 => generated 1724 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:55:15.600752 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-1960ed3c-f7e2-4033-a422-bd25a131389a tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:15.601397 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-1960ed3c-f7e2-4033-a422-bd25a131389a tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] [instance: fbbae31b-cdc9-40b7-b71e-df3a83a3e801] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:15.603285 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG dbcounter [-] [124823] Writing DB stats nova_cell0:SELECT=2 {{(pid=124823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:55:15.604032 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG dbcounter [-] [124823] Writing DB stats nova_cell0:SELECT=6 {{(pid=124823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:55:15.609266 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-1960ed3c-f7e2-4033-a422-bd25a131389a tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:15.609739 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-1960ed3c-f7e2-4033-a422-bd25a131389a tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:15.610508 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-1960ed3c-f7e2-4033-a422-bd25a131389a tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:15.610947 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-1960ed3c-f7e2-4033-a422-bd25a131389a tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:15.755784 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-1960ed3c-f7e2-4033-a422-bd25a131389a tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1cdcc03aee2493eb40013a66243cf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a43dd5e9d7841419a87df430827af67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:15.763769 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-1960ed3c-f7e2-4033-a422-bd25a131389a tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] 10.222.0.41 "GET /compute/v2.1/servers/fbbae31b-cdc9-40b7-b71e-df3a83a3e801" status: 200 len: 1314 microversion: 2.1 time: 0.167388 May 26 12:55:15.764341 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 448/893] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:55:15 2022] GET /compute/v2.1/servers/fbbae31b-cdc9-40b7-b71e-df3a83a3e801 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:55:15.805218 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-2ebab51d-2ba0-4930-ae95-15a44e3075ca tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:15.809650 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-2ebab51d-2ba0-4930-ae95-15a44e3075ca tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] [instance: 7f3fde81-3f47-4590-ad2e-330bd31ed1f7] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:15.809650 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG dbcounter [-] [124824] Writing DB stats nova_cell0:SELECT=2 {{(pid=124824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:55:15.813877 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-2ebab51d-2ba0-4930-ae95-15a44e3075ca tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:15.814373 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-2ebab51d-2ba0-4930-ae95-15a44e3075ca tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:15.815228 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-2ebab51d-2ba0-4930-ae95-15a44e3075ca tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:15.815663 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-2ebab51d-2ba0-4930-ae95-15a44e3075ca tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:15.961380 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-2ebab51d-2ba0-4930-ae95-15a44e3075ca tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa52505a079041efbbf14fb04da7ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe580a28eae4195be1491ac29d373a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:15.970032 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-2ebab51d-2ba0-4930-ae95-15a44e3075ca tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] 10.222.0.41 "GET /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7" status: 200 len: 1724 microversion: 2.1 time: 0.169865 May 26 12:55:15.970924 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 446/894] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:55:15 2022] GET /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7 => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:55:16.780575 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-c4b4ff35-1208-46d8-b0f2-baa00679d320 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:16.781228 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-c4b4ff35-1208-46d8-b0f2-baa00679d320 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] [instance: fbbae31b-cdc9-40b7-b71e-df3a83a3e801] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:16.787767 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-c4b4ff35-1208-46d8-b0f2-baa00679d320 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:16.788230 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-c4b4ff35-1208-46d8-b0f2-baa00679d320 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:16.789369 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-c4b4ff35-1208-46d8-b0f2-baa00679d320 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:16.789888 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-c4b4ff35-1208-46d8-b0f2-baa00679d320 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:16.920974 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-c4b4ff35-1208-46d8-b0f2-baa00679d320 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1cdcc03aee2493eb40013a66243cf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a43dd5e9d7841419a87df430827af67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:16.929319 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-c4b4ff35-1208-46d8-b0f2-baa00679d320 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] 10.222.0.41 "GET /compute/v2.1/servers/fbbae31b-cdc9-40b7-b71e-df3a83a3e801" status: 200 len: 1498 microversion: 2.1 time: 0.152651 May 26 12:55:16.929954 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 449/895] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:55:16 2022] GET /compute/v2.1/servers/fbbae31b-cdc9-40b7-b71e-df3a83a3e801 => generated 1498 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:55:16.988135 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-79256c18-91b8-4003-8e81-31e1abe2db64 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:16.989305 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-79256c18-91b8-4003-8e81-31e1abe2db64 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] [instance: 7f3fde81-3f47-4590-ad2e-330bd31ed1f7] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:16.995964 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-79256c18-91b8-4003-8e81-31e1abe2db64 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:16.996414 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-79256c18-91b8-4003-8e81-31e1abe2db64 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:16.997183 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-79256c18-91b8-4003-8e81-31e1abe2db64 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:16.997620 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-79256c18-91b8-4003-8e81-31e1abe2db64 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:17.132651 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-79256c18-91b8-4003-8e81-31e1abe2db64 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa52505a079041efbbf14fb04da7ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe580a28eae4195be1491ac29d373a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:17.141387 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-79256c18-91b8-4003-8e81-31e1abe2db64 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] 10.222.0.41 "GET /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7" status: 200 len: 1724 microversion: 2.1 time: 0.157031 May 26 12:55:17.142006 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 447/896] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:55:16 2022] GET /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:55:17.968228 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-ae8fbecd-3b9a-4824-9b49-ba654508a80c tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:17.968749 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-ae8fbecd-3b9a-4824-9b49-ba654508a80c tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] [instance: fbbae31b-cdc9-40b7-b71e-df3a83a3e801] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:17.978425 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-ae8fbecd-3b9a-4824-9b49-ba654508a80c tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:17.978877 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-ae8fbecd-3b9a-4824-9b49-ba654508a80c tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:17.979686 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-ae8fbecd-3b9a-4824-9b49-ba654508a80c tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:17.980127 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-ae8fbecd-3b9a-4824-9b49-ba654508a80c tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:18.006284 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-ae8fbecd-3b9a-4824-9b49-ba654508a80c tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] [instance: fbbae31b-cdc9-40b7-b71e-df3a83a3e801] Going to try to terminate instance {{(pid=124823) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 12:55:18.158252 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-100ed101-cf9c-4ec7-9ab6-8456d5a605cc tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:18.158815 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-100ed101-cf9c-4ec7-9ab6-8456d5a605cc tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] [instance: 7f3fde81-3f47-4590-ad2e-330bd31ed1f7] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:18.165997 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-100ed101-cf9c-4ec7-9ab6-8456d5a605cc tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:18.166437 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-100ed101-cf9c-4ec7-9ab6-8456d5a605cc tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:18.167194 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-100ed101-cf9c-4ec7-9ab6-8456d5a605cc tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:18.167626 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-100ed101-cf9c-4ec7-9ab6-8456d5a605cc tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:18.301951 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-100ed101-cf9c-4ec7-9ab6-8456d5a605cc tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa52505a079041efbbf14fb04da7ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe580a28eae4195be1491ac29d373a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:18.310943 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-100ed101-cf9c-4ec7-9ab6-8456d5a605cc tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] 10.222.0.41 "GET /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7" status: 200 len: 1724 microversion: 2.1 time: 0.156651 May 26 12:55:18.312476 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 448/897] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:55:18 2022] GET /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:55:18.356222 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-ae8fbecd-3b9a-4824-9b49-ba654508a80c tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] 10.222.0.41 "DELETE /compute/v2.1/servers/fbbae31b-cdc9-40b7-b71e-df3a83a3e801" status: 204 len: 0 microversion: 2.1 time: 0.391522 May 26 12:55:18.356859 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 450/898] 10.222.0.41 () {58 vars in 1238 bytes} [Thu May 26 12:55:17 2022] DELETE /compute/v2.1/servers/fbbae31b-cdc9-40b7-b71e-df3a83a3e801 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 12:55:18.365832 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-9b2354d4-bf57-4afe-aa48-c84b0f276723 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:18.366454 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-9b2354d4-bf57-4afe-aa48-c84b0f276723 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] [instance: fbbae31b-cdc9-40b7-b71e-df3a83a3e801] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:18.373263 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-9b2354d4-bf57-4afe-aa48-c84b0f276723 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:18.373732 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-9b2354d4-bf57-4afe-aa48-c84b0f276723 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:18.374547 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-9b2354d4-bf57-4afe-aa48-c84b0f276723 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:18.374941 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-9b2354d4-bf57-4afe-aa48-c84b0f276723 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:18.513700 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-9b2354d4-bf57-4afe-aa48-c84b0f276723 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1cdcc03aee2493eb40013a66243cf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a43dd5e9d7841419a87df430827af67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:18.521352 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-9b2354d4-bf57-4afe-aa48-c84b0f276723 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] 10.222.0.41 "GET /compute/v2.1/servers/fbbae31b-cdc9-40b7-b71e-df3a83a3e801" status: 200 len: 1504 microversion: 2.1 time: 0.160020 May 26 12:55:18.521972 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 449/899] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:55:18 2022] GET /compute/v2.1/servers/fbbae31b-cdc9-40b7-b71e-df3a83a3e801 => generated 1504 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:55:19.329594 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-76b90586-58f3-4ce6-8932-1df0da2bdc58 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:19.330322 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-76b90586-58f3-4ce6-8932-1df0da2bdc58 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] [instance: 7f3fde81-3f47-4590-ad2e-330bd31ed1f7] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:19.337933 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-76b90586-58f3-4ce6-8932-1df0da2bdc58 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:19.338307 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-76b90586-58f3-4ce6-8932-1df0da2bdc58 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:19.339092 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-76b90586-58f3-4ce6-8932-1df0da2bdc58 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:19.339563 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-76b90586-58f3-4ce6-8932-1df0da2bdc58 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:19.473458 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-76b90586-58f3-4ce6-8932-1df0da2bdc58 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa52505a079041efbbf14fb04da7ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe580a28eae4195be1491ac29d373a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:19.481709 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-76b90586-58f3-4ce6-8932-1df0da2bdc58 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] 10.222.0.41 "GET /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7" status: 200 len: 1724 microversion: 2.1 time: 0.156462 May 26 12:55:19.482284 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 451/900] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:55:19 2022] GET /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:55:19.538482 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-c4ee924b-ec26-4e13-a504-899c0dc72040 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:19.539100 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-c4ee924b-ec26-4e13-a504-899c0dc72040 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] [instance: fbbae31b-cdc9-40b7-b71e-df3a83a3e801] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:19.545769 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-c4ee924b-ec26-4e13-a504-899c0dc72040 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:19.546218 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-c4ee924b-ec26-4e13-a504-899c0dc72040 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:19.546985 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-c4ee924b-ec26-4e13-a504-899c0dc72040 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:19.547417 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-c4ee924b-ec26-4e13-a504-899c0dc72040 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:19.675476 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-c4ee924b-ec26-4e13-a504-899c0dc72040 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1cdcc03aee2493eb40013a66243cf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a43dd5e9d7841419a87df430827af67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:19.683483 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-c4ee924b-ec26-4e13-a504-899c0dc72040 tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] 10.222.0.41 "GET /compute/v2.1/servers/fbbae31b-cdc9-40b7-b71e-df3a83a3e801" status: 200 len: 1504 microversion: 2.1 time: 0.148892 May 26 12:55:19.684042 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 450/901] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:55:19 2022] GET /compute/v2.1/servers/fbbae31b-cdc9-40b7-b71e-df3a83a3e801 => generated 1504 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:55:20.498255 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-f3cef242-e941-424f-a45a-e3975289e034 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:20.499094 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-f3cef242-e941-424f-a45a-e3975289e034 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] [instance: 7f3fde81-3f47-4590-ad2e-330bd31ed1f7] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:20.506592 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-f3cef242-e941-424f-a45a-e3975289e034 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:20.507042 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-f3cef242-e941-424f-a45a-e3975289e034 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:20.507822 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-f3cef242-e941-424f-a45a-e3975289e034 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:20.508258 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-f3cef242-e941-424f-a45a-e3975289e034 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:20.606081 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [req-3ea9a54c-f14c-4334-a543-529d9dc5e0b3 req-09cbe7f0-7b53-431f-a76c-9e751fd50731 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbbae31b-cdc9-40b7-b71e-df3a83a3e801", "name": "network-vif-deleted", "tag": "d0e3d57f-d53e-482b-be49-8e6c8d1121c4"}]} {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:55:20.610105 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG dbcounter [-] [124824] Writing DB stats nova_api:SELECT=56 {{(pid=124824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:55:20.616182 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [req-3ea9a54c-f14c-4334-a543-529d9dc5e0b3 req-09cbe7f0-7b53-431f-a76c-9e751fd50731 service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:20.632589 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [req-3ea9a54c-f14c-4334-a543-529d9dc5e0b3 req-09cbe7f0-7b53-431f-a76c-9e751fd50731 service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:20.632589 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.compute.server_external_events [req-3ea9a54c-f14c-4334-a543-529d9dc5e0b3 req-09cbe7f0-7b53-431f-a76c-9e751fd50731 service nova] Creating event network-vif-deleted:d0e3d57f-d53e-482b-be49-8e6c8d1121c4 for instance fbbae31b-cdc9-40b7-b71e-df3a83a3e801 on hv-cinder-81571 May 26 12:55:20.635399 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [req-3ea9a54c-f14c-4334-a543-529d9dc5e0b3 req-09cbe7f0-7b53-431f-a76c-9e751fd50731 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033125 May 26 12:55:20.636265 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 451/902] 10.222.0.41 () {64 vars in 1317 bytes} [Thu May 26 12:55:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:55:20.678414 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-f3cef242-e941-424f-a45a-e3975289e034 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa52505a079041efbbf14fb04da7ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe580a28eae4195be1491ac29d373a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:20.682231 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG dbcounter [-] [124823] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:55:20.687016 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-f3cef242-e941-424f-a45a-e3975289e034 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] 10.222.0.41 "GET /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7" status: 200 len: 1724 microversion: 2.1 time: 0.192836 May 26 12:55:20.690689 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 452/903] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:55:20 2022] GET /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7 => generated 1724 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:55:20.700963 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-aa387dca-ade2-4c36-b792-2cba710129be tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:20.701689 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-aa387dca-ade2-4c36-b792-2cba710129be tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] [instance: fbbae31b-cdc9-40b7-b71e-df3a83a3e801] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:20.708134 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-aa387dca-ade2-4c36-b792-2cba710129be tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:20.708600 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-aa387dca-ade2-4c36-b792-2cba710129be tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:20.709380 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-aa387dca-ade2-4c36-b792-2cba710129be tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:20.709849 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-aa387dca-ade2-4c36-b792-2cba710129be tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:20.776044 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-aa387dca-ade2-4c36-b792-2cba710129be tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1cdcc03aee2493eb40013a66243cf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a43dd5e9d7841419a87df430827af67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:20.784580 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-aa387dca-ade2-4c36-b792-2cba710129be tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] 10.222.0.41 "GET /compute/v2.1/servers/fbbae31b-cdc9-40b7-b71e-df3a83a3e801" status: 200 len: 1462 microversion: 2.1 time: 0.088011 May 26 12:55:20.785658 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 452/904] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:55:20 2022] GET /compute/v2.1/servers/fbbae31b-cdc9-40b7-b71e-df3a83a3e801 => generated 1462 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:55:21.704904 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-03cb2231-7d23-4a82-a66e-511819121a5e tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:21.705450 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-03cb2231-7d23-4a82-a66e-511819121a5e tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] [instance: 7f3fde81-3f47-4590-ad2e-330bd31ed1f7] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:21.713048 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-03cb2231-7d23-4a82-a66e-511819121a5e tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:21.713495 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-03cb2231-7d23-4a82-a66e-511819121a5e tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:21.714299 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-03cb2231-7d23-4a82-a66e-511819121a5e tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:21.714736 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-03cb2231-7d23-4a82-a66e-511819121a5e tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:21.801447 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-5d8140d7-a44c-420e-b3fe-9648af198b7b tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:21.802086 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-5d8140d7-a44c-420e-b3fe-9648af198b7b tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] [instance: fbbae31b-cdc9-40b7-b71e-df3a83a3e801] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:21.809011 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-5d8140d7-a44c-420e-b3fe-9648af198b7b tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:21.809494 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-5d8140d7-a44c-420e-b3fe-9648af198b7b tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:21.810301 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-5d8140d7-a44c-420e-b3fe-9648af198b7b tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:21.811609 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-5d8140d7-a44c-420e-b3fe-9648af198b7b tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:21.824989 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.wsgi [None req-5d8140d7-a44c-420e-b3fe-9648af198b7b tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] HTTP exception thrown: Instance fbbae31b-cdc9-40b7-b71e-df3a83a3e801 could not be found. May 26 12:55:21.826688 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-5d8140d7-a44c-420e-b3fe-9648af198b7b tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Request method failure captured: May 26 12:55:21.826688 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: request: GET /compute/v2.1/servers/fbbae31b-cdc9-40b7-b71e-df3a83a3e801 HTTP/1.1 May 26 12:55:21.826688 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Accept: application/json May 26 12:55:21.826688 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Accept-Encoding: identity May 26 12:55:21.826688 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Connection: close May 26 12:55:21.826688 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Content-Length: 0 May 26 12:55:21.826688 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Content-Type: application/json May 26 12:55:21.826688 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Host: 10.222.0.41 May 26 12:55:21.826688 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Openstack-System-Scope: None May 26 12:55:21.826688 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: User-Agent: python-urllib3/1.26.9 May 26 12:55:21.826688 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Auth-Token: gAAAAABij3iVZg6UqUMyFK4KNPGo6f5DmkjrcinlaO2pv82CdE0fkJJhBAEBVLG3dt4GTYRBhcv-BXQLCjGkAzLctJsxix3CWMg-KVfO5tov2ze5Wzx3mUq5Wr8RiCmMekZAfNSZD2uBUbmYWXh3sb6NTbOanGcvGN7K7N9CMeDOI5GFEZ2gxf0 May 26 12:55:21.826688 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Domain-Id: None May 26 12:55:21.826688 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Domain-Name: None May 26 12:55:21.826688 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Identity-Status: Confirmed May 26 12:55:21.826688 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Is-Admin-Project: True May 26 12:55:21.826688 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Domain-Id: default May 26 12:55:21.826688 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Domain-Name: Default May 26 12:55:21.826688 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Id: 6a43dd5e9d7841419a87df430827af67 May 26 12:55:21.826688 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Name: tempest-VolumesActionsTest-482744866 May 26 12:55:21.826688 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Role: member,reader May 26 12:55:21.826688 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Roles: member,reader May 26 12:55:21.828273 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/6a43dd5e9d7841419a87df430827af67"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/6a43dd5e9d7841419a87df430827af67"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/6a43dd5e9d7841419a87df430827af67"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_6a43dd5e9d7841419a87df430827af67", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 26 12:55:21.828273 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Tenant: tempest-VolumesActionsTest-482744866 May 26 12:55:21.828273 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Tenant-Id: 6a43dd5e9d7841419a87df430827af67 May 26 12:55:21.828273 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Tenant-Name: tempest-VolumesActionsTest-482744866 May 26 12:55:21.828273 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User: tempest-VolumesActionsTest-482744866-project May 26 12:55:21.828273 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Domain-Id: default May 26 12:55:21.828273 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Domain-Name: Default May 26 12:55:21.828273 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Id: f1cdcc03aee2493eb40013a66243cf38 May 26 12:55:21.828273 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Name: tempest-VolumesActionsTest-482744866-project May 26 12:55:21.828273 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: method: > May 26 12:55:21.828273 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: exception: Instance fbbae31b-cdc9-40b7-b71e-df3a83a3e801 could not be found. May 26 12:55:21.828273 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: action_args: {'id': 'fbbae31b-cdc9-40b7-b71e-df3a83a3e801'} May 26 12:55:21.828273 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:55:21.829168 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:55:21.829168 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:55:21.829168 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:55:21.829168 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:55:21.829168 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:55:21.829168 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:55:21.829168 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:55:21.829168 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:55:21.829168 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:55:21.829168 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbbae31b-cdc9-40b7-b71e-df3a83a3e801 could not be found. May 26 12:55:21.829168 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:55:21.829168 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:55:21.829168 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:55:21.829168 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:55:21.829168 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:55:21.829168 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:55:21.829168 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:55:21.829168 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:55:21.829168 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:55:21.829168 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:55:21.830488 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 12:55:21.830488 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 12:55:21.830488 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:55:21.830488 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:55:21.830488 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:55:21.830488 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:55:21.830488 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbbae31b-cdc9-40b7-b71e-df3a83a3e801 could not be found. May 26 12:55:21.830488 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:55:21.830488 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:55:21.830488 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:55:21.830488 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:55:21.830488 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:55:21.830488 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:55:21.830488 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:55:21.830488 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:55:21.830488 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbbae31b-cdc9-40b7-b71e-df3a83a3e801 could not be found. May 26 12:55:21.830488 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:55:21.831582 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-5d8140d7-a44c-420e-b3fe-9648af198b7b tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] Returning 404 to user: Instance fbbae31b-cdc9-40b7-b71e-df3a83a3e801 could not be found. {{(pid=124824) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:55:21.831582 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-5d8140d7-a44c-420e-b3fe-9648af198b7b tempest-VolumesActionsTest-482744866 tempest-VolumesActionsTest-482744866-project] 10.222.0.41 "GET /compute/v2.1/servers/fbbae31b-cdc9-40b7-b71e-df3a83a3e801" status: 404 len: 111 microversion: 2.1 time: 0.030586 May 26 12:55:21.831582 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 453/905] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:55:21 2022] GET /compute/v2.1/servers/fbbae31b-cdc9-40b7-b71e-df3a83a3e801 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 12:55:21.854943 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-03cb2231-7d23-4a82-a66e-511819121a5e tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa52505a079041efbbf14fb04da7ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe580a28eae4195be1491ac29d373a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:21.864025 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-03cb2231-7d23-4a82-a66e-511819121a5e tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] 10.222.0.41 "GET /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7" status: 200 len: 1724 microversion: 2.1 time: 0.162961 May 26 12:55:21.864698 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 453/906] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:55:21 2022] GET /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:55:22.881528 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-a8be2acf-3b03-4dfc-a25c-fae2d1629a11 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:22.882251 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-a8be2acf-3b03-4dfc-a25c-fae2d1629a11 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] [instance: 7f3fde81-3f47-4590-ad2e-330bd31ed1f7] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:22.888642 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-a8be2acf-3b03-4dfc-a25c-fae2d1629a11 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:22.889096 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-a8be2acf-3b03-4dfc-a25c-fae2d1629a11 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:22.889900 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-a8be2acf-3b03-4dfc-a25c-fae2d1629a11 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:22.890351 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-a8be2acf-3b03-4dfc-a25c-fae2d1629a11 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:23.028455 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-a8be2acf-3b03-4dfc-a25c-fae2d1629a11 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa52505a079041efbbf14fb04da7ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe580a28eae4195be1491ac29d373a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:23.036984 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-a8be2acf-3b03-4dfc-a25c-fae2d1629a11 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] 10.222.0.41 "GET /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7" status: 200 len: 1724 microversion: 2.1 time: 0.160022 May 26 12:55:23.039632 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 454/907] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:55:22 2022] GET /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:55:24.054320 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-0626f8b7-7b46-4ca2-8ef5-24a5bbbd7db0 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:24.054929 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-0626f8b7-7b46-4ca2-8ef5-24a5bbbd7db0 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] [instance: 7f3fde81-3f47-4590-ad2e-330bd31ed1f7] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:24.061512 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-0626f8b7-7b46-4ca2-8ef5-24a5bbbd7db0 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:24.061993 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-0626f8b7-7b46-4ca2-8ef5-24a5bbbd7db0 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:24.062765 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-0626f8b7-7b46-4ca2-8ef5-24a5bbbd7db0 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:24.063204 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-0626f8b7-7b46-4ca2-8ef5-24a5bbbd7db0 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:24.196250 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-0626f8b7-7b46-4ca2-8ef5-24a5bbbd7db0 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa52505a079041efbbf14fb04da7ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe580a28eae4195be1491ac29d373a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:24.204347 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-0626f8b7-7b46-4ca2-8ef5-24a5bbbd7db0 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] 10.222.0.41 "GET /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7" status: 200 len: 1724 microversion: 2.1 time: 0.153933 May 26 12:55:24.204913 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 454/908] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:55:24 2022] GET /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:55:25.221055 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-4f3cd106-cf87-4ecd-a543-78b062c2038d tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:25.221710 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-4f3cd106-cf87-4ecd-a543-78b062c2038d tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] [instance: 7f3fde81-3f47-4590-ad2e-330bd31ed1f7] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:25.229140 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-4f3cd106-cf87-4ecd-a543-78b062c2038d tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:25.229596 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-4f3cd106-cf87-4ecd-a543-78b062c2038d tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:25.230403 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-4f3cd106-cf87-4ecd-a543-78b062c2038d tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:25.230846 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-4f3cd106-cf87-4ecd-a543-78b062c2038d tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:25.358086 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-4f3cd106-cf87-4ecd-a543-78b062c2038d tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa52505a079041efbbf14fb04da7ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe580a28eae4195be1491ac29d373a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:25.366770 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-4f3cd106-cf87-4ecd-a543-78b062c2038d tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] 10.222.0.41 "GET /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7" status: 200 len: 1724 microversion: 2.1 time: 0.149819 May 26 12:55:25.367347 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 455/909] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:55:25 2022] GET /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:55:26.384653 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-49fe6822-8d28-4344-821d-fedce2916a9d tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:26.385376 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-49fe6822-8d28-4344-821d-fedce2916a9d tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] [instance: 7f3fde81-3f47-4590-ad2e-330bd31ed1f7] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:26.391936 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-49fe6822-8d28-4344-821d-fedce2916a9d tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:26.392380 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-49fe6822-8d28-4344-821d-fedce2916a9d tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:26.393132 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-49fe6822-8d28-4344-821d-fedce2916a9d tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:26.393564 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-49fe6822-8d28-4344-821d-fedce2916a9d tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:26.525972 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-49fe6822-8d28-4344-821d-fedce2916a9d tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa52505a079041efbbf14fb04da7ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe580a28eae4195be1491ac29d373a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:26.533063 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-49fe6822-8d28-4344-821d-fedce2916a9d tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] 10.222.0.41 "GET /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7" status: 200 len: 1724 microversion: 2.1 time: 0.152288 May 26 12:55:26.533626 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 455/910] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:55:26 2022] GET /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:55:27.550238 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-41e6ab56-c7b2-4dbd-a0df-a554294e0013 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:27.551773 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-41e6ab56-c7b2-4dbd-a0df-a554294e0013 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] [instance: 7f3fde81-3f47-4590-ad2e-330bd31ed1f7] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:27.559909 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-41e6ab56-c7b2-4dbd-a0df-a554294e0013 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:27.560456 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-41e6ab56-c7b2-4dbd-a0df-a554294e0013 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:27.561406 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-41e6ab56-c7b2-4dbd-a0df-a554294e0013 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:27.561975 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-41e6ab56-c7b2-4dbd-a0df-a554294e0013 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:27.565417 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG dbcounter [-] [124824] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=95,nova_cell1:INSERT=2 {{(pid=124824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:55:27.747949 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-41e6ab56-c7b2-4dbd-a0df-a554294e0013 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa52505a079041efbbf14fb04da7ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe580a28eae4195be1491ac29d373a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:27.757024 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-41e6ab56-c7b2-4dbd-a0df-a554294e0013 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] 10.222.0.41 "GET /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7" status: 200 len: 1724 microversion: 2.1 time: 0.210993 May 26 12:55:27.757593 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 456/911] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:55:27 2022] GET /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7 => generated 1724 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:55:28.777131 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-9d125cd8-ca15-40a3-a27b-99e8eb12c76e tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:28.779284 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-9d125cd8-ca15-40a3-a27b-99e8eb12c76e tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] [instance: 7f3fde81-3f47-4590-ad2e-330bd31ed1f7] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:28.787145 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-9d125cd8-ca15-40a3-a27b-99e8eb12c76e tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:28.787738 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-9d125cd8-ca15-40a3-a27b-99e8eb12c76e tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:28.788721 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-9d125cd8-ca15-40a3-a27b-99e8eb12c76e tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:28.789345 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-9d125cd8-ca15-40a3-a27b-99e8eb12c76e tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:28.938278 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-9d125cd8-ca15-40a3-a27b-99e8eb12c76e tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa52505a079041efbbf14fb04da7ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe580a28eae4195be1491ac29d373a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:28.948901 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-9d125cd8-ca15-40a3-a27b-99e8eb12c76e tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] 10.222.0.41 "GET /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7" status: 200 len: 1724 microversion: 2.1 time: 0.177178 May 26 12:55:28.949804 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 456/912] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:55:28 2022] GET /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7 => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:55:29.966813 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-47a61368-7b44-41d5-8ea1-4e4ae30dad88 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:29.967512 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-47a61368-7b44-41d5-8ea1-4e4ae30dad88 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] [instance: 7f3fde81-3f47-4590-ad2e-330bd31ed1f7] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:29.974032 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-47a61368-7b44-41d5-8ea1-4e4ae30dad88 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:29.976784 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-47a61368-7b44-41d5-8ea1-4e4ae30dad88 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:29.976784 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-47a61368-7b44-41d5-8ea1-4e4ae30dad88 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:29.976784 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-47a61368-7b44-41d5-8ea1-4e4ae30dad88 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:30.132673 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-47a61368-7b44-41d5-8ea1-4e4ae30dad88 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa52505a079041efbbf14fb04da7ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe580a28eae4195be1491ac29d373a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:30.141405 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-47a61368-7b44-41d5-8ea1-4e4ae30dad88 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] 10.222.0.41 "GET /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7" status: 200 len: 1701 microversion: 2.1 time: 0.178490 May 26 12:55:30.153335 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 457/913] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:55:29 2022] GET /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7 => generated 1701 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:55:30.161205 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-8de99215-7f25-4ccb-b82a-29b04f4a4736 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:55:30.169551 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-8de99215-7f25-4ccb-b82a-29b04f4a4736 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:30.170071 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-8de99215-7f25-4ccb-b82a-29b04f4a4736 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:30.236223 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-8de99215-7f25-4ccb-b82a-29b04f4a4736 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] [instance: 7f3fde81-3f47-4590-ad2e-330bd31ed1f7] Going to try to start instance {{(pid=124823) start /opt/stack/nova/nova/compute/api.py:2730}} May 26 12:55:30.445984 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-8de99215-7f25-4ccb-b82a-29b04f4a4736 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] 10.222.0.41 "POST /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7/action" status: 202 len: 0 microversion: 2.1 time: 0.288946 May 26 12:55:30.449619 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 457/914] 10.222.0.41 () {60 vars in 1277 bytes} [Thu May 26 12:55:30 2022] POST /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7/action => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 12:55:30.460408 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-aa443346-ef57-43e0-9a2a-b5cbc51164a0 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:30.461681 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-aa443346-ef57-43e0-9a2a-b5cbc51164a0 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] [instance: 7f3fde81-3f47-4590-ad2e-330bd31ed1f7] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:30.468729 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-aa443346-ef57-43e0-9a2a-b5cbc51164a0 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:30.469492 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-aa443346-ef57-43e0-9a2a-b5cbc51164a0 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:30.470302 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-aa443346-ef57-43e0-9a2a-b5cbc51164a0 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:30.470736 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-aa443346-ef57-43e0-9a2a-b5cbc51164a0 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:30.660299 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-aa443346-ef57-43e0-9a2a-b5cbc51164a0 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa52505a079041efbbf14fb04da7ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe580a28eae4195be1491ac29d373a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:30.669570 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-aa443346-ef57-43e0-9a2a-b5cbc51164a0 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] 10.222.0.41 "GET /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7" status: 200 len: 1710 microversion: 2.1 time: 0.216800 May 26 12:55:30.670710 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 458/915] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:55:30 2022] GET /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7 => generated 1710 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:55:31.691534 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-fb0a5f08-0c2a-412c-9fb6-4e6ba83f258b tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:31.693359 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-fb0a5f08-0c2a-412c-9fb6-4e6ba83f258b tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] [instance: 7f3fde81-3f47-4590-ad2e-330bd31ed1f7] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:31.704293 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-fb0a5f08-0c2a-412c-9fb6-4e6ba83f258b tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:31.704857 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-fb0a5f08-0c2a-412c-9fb6-4e6ba83f258b tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:31.705884 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-fb0a5f08-0c2a-412c-9fb6-4e6ba83f258b tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:31.706414 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-fb0a5f08-0c2a-412c-9fb6-4e6ba83f258b tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:31.877205 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-fb0a5f08-0c2a-412c-9fb6-4e6ba83f258b tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa52505a079041efbbf14fb04da7ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe580a28eae4195be1491ac29d373a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:31.884808 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-fb0a5f08-0c2a-412c-9fb6-4e6ba83f258b tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] 10.222.0.41 "GET /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7" status: 200 len: 1710 microversion: 2.1 time: 0.199475 May 26 12:55:31.885833 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 458/916] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:55:31 2022] GET /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7 => generated 1710 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:55:32.902638 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-446d0994-0221-4f42-a7c1-42fcd835afa9 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:55:32.903245 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-446d0994-0221-4f42-a7c1-42fcd835afa9 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] [instance: 7f3fde81-3f47-4590-ad2e-330bd31ed1f7] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:55:32.910605 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-446d0994-0221-4f42-a7c1-42fcd835afa9 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:32.913860 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-446d0994-0221-4f42-a7c1-42fcd835afa9 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:32.913860 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-446d0994-0221-4f42-a7c1-42fcd835afa9 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:55:32.913860 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-446d0994-0221-4f42-a7c1-42fcd835afa9 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:55:33.056719 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-446d0994-0221-4f42-a7c1-42fcd835afa9 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa52505a079041efbbf14fb04da7ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe580a28eae4195be1491ac29d373a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:55:33.066935 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-446d0994-0221-4f42-a7c1-42fcd835afa9 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] 10.222.0.41 "GET /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7" status: 200 len: 1714 microversion: 2.1 time: 0.167989 May 26 12:55:33.070169 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 459/917] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:55:32 2022] GET /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7 => generated 1714 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:56:00.223570 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-9e5ddd5f-a62b-4ca1-87de-03e28c1e01f2 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1620363328"}} {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:56:00.224227 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-9e5ddd5f-a62b-4ca1-87de-03e28c1e01f2 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] [instance: d1efb756-8e30-4c05-9156-de4ae119ac3c] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:56:00.226786 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG dbcounter [-] [124823] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=124823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:56:00.227590 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG dbcounter [-] [124823] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:56:00.232259 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-9e5ddd5f-a62b-4ca1-87de-03e28c1e01f2 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:00.232700 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-9e5ddd5f-a62b-4ca1-87de-03e28c1e01f2 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:00.233468 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-9e5ddd5f-a62b-4ca1-87de-03e28c1e01f2 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:00.233926 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-9e5ddd5f-a62b-4ca1-87de-03e28c1e01f2 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:00.358026 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.network.security_group_api [None req-9e5ddd5f-a62b-4ca1-87de-03e28c1e01f2 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Removing security group 775e2963-7f6f-4932-a16e-e3eeb135a7ed from port 114a1a6a-836f-4257-81d6-756de175e28e May 26 12:56:00.790168 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-9e5ddd5f-a62b-4ca1-87de-03e28c1e01f2 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] 10.222.0.41 "POST /compute/v2.1/servers/d1efb756-8e30-4c05-9156-de4ae119ac3c/action" status: 202 len: 0 microversion: 2.1 time: 0.570411 May 26 12:56:00.800227 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [req-a42b1481-d53d-4d9b-8210-269313f5bc0e req-23a0948d-7386-46ac-81a3-a463c555f40b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1efb756-8e30-4c05-9156-de4ae119ac3c", "tag": "114a1a6a-836f-4257-81d6-756de175e28e"}]} {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:56:00.805791 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 459/918] 10.222.0.41 () {60 vars in 1277 bytes} [Thu May 26 12:56:00 2022] POST /compute/v2.1/servers/d1efb756-8e30-4c05-9156-de4ae119ac3c/action => generated 0 bytes in 587 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 12:56:00.816011 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG dbcounter [-] [124824] Writing DB stats nova_api:SELECT=17 {{(pid=124824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:56:00.817601 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG dbcounter [-] [124824] Writing DB stats nova_cell1:SELECT=23 {{(pid=124824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:56:00.821791 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [req-a42b1481-d53d-4d9b-8210-269313f5bc0e req-23a0948d-7386-46ac-81a3-a463c555f40b service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:00.822652 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [req-a42b1481-d53d-4d9b-8210-269313f5bc0e req-23a0948d-7386-46ac-81a3-a463c555f40b service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:00.836959 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.compute.server_external_events [req-a42b1481-d53d-4d9b-8210-269313f5bc0e req-23a0948d-7386-46ac-81a3-a463c555f40b service nova] Creating event network-changed:114a1a6a-836f-4257-81d6-756de175e28e for instance d1efb756-8e30-4c05-9156-de4ae119ac3c on hv-cinder-81571 May 26 12:56:00.844003 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [req-a42b1481-d53d-4d9b-8210-269313f5bc0e req-23a0948d-7386-46ac-81a3-a463c555f40b service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046799 May 26 12:56:00.845148 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 460/919] 10.222.0.41 () {64 vars in 1317 bytes} [Thu May 26 12:56:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:56:02.254818 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-5e1bf095-a84f-4d1a-b07e-e1ae020f2287 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:56:02.255340 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-5e1bf095-a84f-4d1a-b07e-e1ae020f2287 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] [instance: d1efb756-8e30-4c05-9156-de4ae119ac3c] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:56:02.255449 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [req-9dea0fa9-3ed7-4863-9e75-cb9b7611e0c5 req-e928fe60-2463-4462-9334-1b5f4f02f899 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1efb756-8e30-4c05-9156-de4ae119ac3c", "tag": "114a1a6a-836f-4257-81d6-756de175e28e"}]} {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:56:02.262378 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-5e1bf095-a84f-4d1a-b07e-e1ae020f2287 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:02.262910 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-5e1bf095-a84f-4d1a-b07e-e1ae020f2287 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:02.264166 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-5e1bf095-a84f-4d1a-b07e-e1ae020f2287 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:02.264683 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-5e1bf095-a84f-4d1a-b07e-e1ae020f2287 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:02.265003 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [req-9dea0fa9-3ed7-4863-9e75-cb9b7611e0c5 req-e928fe60-2463-4462-9334-1b5f4f02f899 service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:02.265444 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [req-9dea0fa9-3ed7-4863-9e75-cb9b7611e0c5 req-e928fe60-2463-4462-9334-1b5f4f02f899 service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:02.277029 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.compute.server_external_events [req-9dea0fa9-3ed7-4863-9e75-cb9b7611e0c5 req-e928fe60-2463-4462-9334-1b5f4f02f899 service nova] Creating event network-changed:114a1a6a-836f-4257-81d6-756de175e28e for instance d1efb756-8e30-4c05-9156-de4ae119ac3c on hv-cinder-81571 May 26 12:56:02.282756 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [req-9dea0fa9-3ed7-4863-9e75-cb9b7611e0c5 req-e928fe60-2463-4462-9334-1b5f4f02f899 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031306 May 26 12:56:02.283602 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 461/920] 10.222.0.41 () {64 vars in 1317 bytes} [Thu May 26 12:56:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:56:02.358672 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.objects.instance [None req-5e1bf095-a84f-4d1a-b07e-e1ae020f2287 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lazy-loading 'services' on Instance uuid d1efb756-8e30-4c05-9156-de4ae119ac3c {{(pid=124823) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:56:02.587614 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-5e1bf095-a84f-4d1a-b07e-e1ae020f2287 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] 10.222.0.41 "DELETE /compute/v2.1/servers/d1efb756-8e30-4c05-9156-de4ae119ac3c/os-volume_attachments/3a1babfd-7276-4da6-adcf-6cd805b82e2b" status: 202 len: 0 microversion: 2.1 time: 0.337094 May 26 12:56:02.588402 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 460/921] 10.222.0.41 () {58 vars in 1415 bytes} [Thu May 26 12:56:02 2022] DELETE /compute/v2.1/servers/d1efb756-8e30-4c05-9156-de4ae119ac3c/os-volume_attachments/3a1babfd-7276-4da6-adcf-6cd805b82e2b => generated 0 bytes in 339 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 12:56:02.597550 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-97697ab5-cb5a-4b7c-aaef-e110bf030f11 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:56:02.598621 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-97697ab5-cb5a-4b7c-aaef-e110bf030f11 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] [instance: d1efb756-8e30-4c05-9156-de4ae119ac3c] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:56:02.606005 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-97697ab5-cb5a-4b7c-aaef-e110bf030f11 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:02.606448 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-97697ab5-cb5a-4b7c-aaef-e110bf030f11 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:02.607225 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-97697ab5-cb5a-4b7c-aaef-e110bf030f11 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:02.607659 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-97697ab5-cb5a-4b7c-aaef-e110bf030f11 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:02.636667 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-97697ab5-cb5a-4b7c-aaef-e110bf030f11 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] 10.222.0.41 "GET /compute/v2.1/servers/d1efb756-8e30-4c05-9156-de4ae119ac3c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043835 May 26 12:56:02.637235 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 462/922] 10.222.0.41 () {58 vars in 1301 bytes} [Thu May 26 12:56:02 2022] GET /compute/v2.1/servers/d1efb756-8e30-4c05-9156-de4ae119ac3c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:56:03.649886 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-723500b9-77ed-42ca-9a7c-dd2c9bf3f01c tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:56:03.650967 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-723500b9-77ed-42ca-9a7c-dd2c9bf3f01c tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] [instance: d1efb756-8e30-4c05-9156-de4ae119ac3c] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:56:03.657849 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-723500b9-77ed-42ca-9a7c-dd2c9bf3f01c tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:03.658300 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-723500b9-77ed-42ca-9a7c-dd2c9bf3f01c tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:03.659076 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-723500b9-77ed-42ca-9a7c-dd2c9bf3f01c tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:03.659516 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-723500b9-77ed-42ca-9a7c-dd2c9bf3f01c tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:03.688001 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-723500b9-77ed-42ca-9a7c-dd2c9bf3f01c tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] 10.222.0.41 "GET /compute/v2.1/servers/d1efb756-8e30-4c05-9156-de4ae119ac3c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043208 May 26 12:56:03.688562 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 461/923] 10.222.0.41 () {58 vars in 1301 bytes} [Thu May 26 12:56:03 2022] GET /compute/v2.1/servers/d1efb756-8e30-4c05-9156-de4ae119ac3c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:56:04.700128 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-fbf76472-0088-4930-b524-f23c5d6d37ad tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:56:04.701081 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-fbf76472-0088-4930-b524-f23c5d6d37ad tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] [instance: d1efb756-8e30-4c05-9156-de4ae119ac3c] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:56:04.707612 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-fbf76472-0088-4930-b524-f23c5d6d37ad tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:04.708049 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-fbf76472-0088-4930-b524-f23c5d6d37ad tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:04.708798 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-fbf76472-0088-4930-b524-f23c5d6d37ad tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:04.709228 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-fbf76472-0088-4930-b524-f23c5d6d37ad tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:04.738253 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-fbf76472-0088-4930-b524-f23c5d6d37ad tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] 10.222.0.41 "GET /compute/v2.1/servers/d1efb756-8e30-4c05-9156-de4ae119ac3c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042114 May 26 12:56:04.738823 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 463/924] 10.222.0.41 () {58 vars in 1301 bytes} [Thu May 26 12:56:04 2022] GET /compute/v2.1/servers/d1efb756-8e30-4c05-9156-de4ae119ac3c/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 12:56:04.748546 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-e9fd25dd-32c4-45b2-9383-bd2dc49de209 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:56:04.749040 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-e9fd25dd-32c4-45b2-9383-bd2dc49de209 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] [instance: d1efb756-8e30-4c05-9156-de4ae119ac3c] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:56:04.755483 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-e9fd25dd-32c4-45b2-9383-bd2dc49de209 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:04.755928 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-e9fd25dd-32c4-45b2-9383-bd2dc49de209 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:04.756683 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-e9fd25dd-32c4-45b2-9383-bd2dc49de209 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:04.757117 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-e9fd25dd-32c4-45b2-9383-bd2dc49de209 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:04.831192 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.wsgi [None req-e9fd25dd-32c4-45b2-9383-bd2dc49de209 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] HTTP exception thrown: Instance d1efb756-8e30-4c05-9156-de4ae119ac3c is not attached to volume 3a1babfd-7276-4da6-adcf-6cd805b82e2b May 26 12:56:04.848060 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-e9fd25dd-32c4-45b2-9383-bd2dc49de209 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Request method failure captured: May 26 12:56:04.848060 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: request: DELETE /compute/v2.1/servers/d1efb756-8e30-4c05-9156-de4ae119ac3c/os-volume_attachments/3a1babfd-7276-4da6-adcf-6cd805b82e2b HTTP/1.1 May 26 12:56:04.848060 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Accept: application/json May 26 12:56:04.848060 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Accept-Encoding: identity May 26 12:56:04.848060 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Connection: close May 26 12:56:04.848060 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Content-Length: 0 May 26 12:56:04.848060 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Content-Type: application/json May 26 12:56:04.848060 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Host: 10.222.0.41 May 26 12:56:04.848060 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Openstack-System-Scope: None May 26 12:56:04.848060 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: User-Agent: python-urllib3/1.26.9 May 26 12:56:04.848060 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Auth-Token: gAAAAABij3g7V6YUPwevldhTRNjDZ3071UY1Zo9P_HtNAUZF-gBxZVwVBfjzy3OukDFiXMEsKZ8bej0_1g-vBr3nvMaUmdevLEbcZBsi0_kpDEJj31KUJuqTETSIcmF-mQcWX7TQodm8YGTOaLlLTHGzmXO0veEA6BD3GSVokkErHW49YUv-88Q May 26 12:56:04.848060 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Domain-Id: None May 26 12:56:04.848060 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Domain-Name: None May 26 12:56:04.848060 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Identity-Status: Confirmed May 26 12:56:04.848060 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Is-Admin-Project: True May 26 12:56:04.848060 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Project-Domain-Id: default May 26 12:56:04.848060 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Project-Domain-Name: Default May 26 12:56:04.848060 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Project-Id: c876091609fe45ba80370a16748cbeb2 May 26 12:56:04.848060 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Project-Name: tempest-TestMinimumBasicScenario-767154556 May 26 12:56:04.848060 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Role: member,reader May 26 12:56:04.848060 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Roles: member,reader May 26 12:56:04.849822 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/c876091609fe45ba80370a16748cbeb2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/c876091609fe45ba80370a16748cbeb2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/c876091609fe45ba80370a16748cbeb2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_c876091609fe45ba80370a16748cbeb2", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 26 12:56:04.849822 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Tenant: tempest-TestMinimumBasicScenario-767154556 May 26 12:56:04.849822 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Tenant-Id: c876091609fe45ba80370a16748cbeb2 May 26 12:56:04.849822 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Tenant-Name: tempest-TestMinimumBasicScenario-767154556 May 26 12:56:04.849822 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User: tempest-TestMinimumBasicScenario-767154556-project May 26 12:56:04.849822 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User-Domain-Id: default May 26 12:56:04.849822 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User-Domain-Name: Default May 26 12:56:04.849822 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User-Id: 7277aedb35df448e8b3056f8bc395e32 May 26 12:56:04.849822 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User-Name: tempest-TestMinimumBasicScenario-767154556-project May 26 12:56:04.849822 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: method: > May 26 12:56:04.849822 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: exception: Instance d1efb756-8e30-4c05-9156-de4ae119ac3c is not attached to volume 3a1babfd-7276-4da6-adcf-6cd805b82e2b May 26 12:56:04.850704 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: action_args: {'server_id': 'd1efb756-8e30-4c05-9156-de4ae119ac3c', 'id': '3a1babfd-7276-4da6-adcf-6cd805b82e2b'} May 26 12:56:04.850704 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:56:04.850704 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:56:04.850704 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 26 12:56:04.850704 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 26 12:56:04.850704 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 12:56:04.850704 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 12:56:04.850704 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 26 12:56:04.850704 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 26 12:56:04.850704 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 3a1babfd-7276-4da6-adcf-6cd805b82e2b. May 26 12:56:04.850704 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:56:04.850704 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:56:04.850704 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:56:04.850704 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:56:04.850704 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:56:04.850704 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:56:04.850704 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:56:04.850704 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:56:04.850704 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:56:04.850704 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:56:04.852998 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 26 12:56:04.852998 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 26 12:56:04.852998 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1efb756-8e30-4c05-9156-de4ae119ac3c is not attached to volume 3a1babfd-7276-4da6-adcf-6cd805b82e2b May 26 12:56:04.852998 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:56:04.852998 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:56:04.852998 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:56:04.852998 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:56:04.852998 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:56:04.852998 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:56:04.852998 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:56:04.852998 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:56:04.852998 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1efb756-8e30-4c05-9156-de4ae119ac3c is not attached to volume 3a1babfd-7276-4da6-adcf-6cd805b82e2b May 26 12:56:04.852998 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:56:04.852998 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-e9fd25dd-32c4-45b2-9383-bd2dc49de209 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Returning 404 to user: Instance d1efb756-8e30-4c05-9156-de4ae119ac3c is not attached to volume 3a1babfd-7276-4da6-adcf-6cd805b82e2b {{(pid=124823) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:56:04.854332 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-e9fd25dd-32c4-45b2-9383-bd2dc49de209 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] 10.222.0.41 "DELETE /compute/v2.1/servers/d1efb756-8e30-4c05-9156-de4ae119ac3c/os-volume_attachments/3a1babfd-7276-4da6-adcf-6cd805b82e2b" status: 404 len: 154 microversion: 2.1 time: 0.105091 May 26 12:56:04.854332 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 462/925] 10.222.0.41 () {58 vars in 1415 bytes} [Thu May 26 12:56:04 2022] DELETE /compute/v2.1/servers/d1efb756-8e30-4c05-9156-de4ae119ac3c/os-volume_attachments/3a1babfd-7276-4da6-adcf-6cd805b82e2b => generated 154 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:56:06.105412 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-7c8c98da-444b-41b9-9b82-c78651134c36 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:56:06.105929 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-7c8c98da-444b-41b9-9b82-c78651134c36 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] [instance: d1efb756-8e30-4c05-9156-de4ae119ac3c] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:56:06.112306 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-7c8c98da-444b-41b9-9b82-c78651134c36 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:06.112748 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-7c8c98da-444b-41b9-9b82-c78651134c36 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:06.113534 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-7c8c98da-444b-41b9-9b82-c78651134c36 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:06.114003 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-7c8c98da-444b-41b9-9b82-c78651134c36 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:06.137556 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-7c8c98da-444b-41b9-9b82-c78651134c36 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] [instance: d1efb756-8e30-4c05-9156-de4ae119ac3c] Going to try to terminate instance {{(pid=124824) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 12:56:06.410360 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-7c8c98da-444b-41b9-9b82-c78651134c36 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] 10.222.0.41 "DELETE /compute/v2.1/servers/d1efb756-8e30-4c05-9156-de4ae119ac3c" status: 204 len: 0 microversion: 2.1 time: 0.309020 May 26 12:56:06.410868 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 464/926] 10.222.0.41 () {58 vars in 1238 bytes} [Thu May 26 12:56:06 2022] DELETE /compute/v2.1/servers/d1efb756-8e30-4c05-9156-de4ae119ac3c => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 26 12:56:06.418831 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-6d627de3-cca6-4c18-bd15-567fe2ab5f2d tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:56:06.419469 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-6d627de3-cca6-4c18-bd15-567fe2ab5f2d tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] [instance: d1efb756-8e30-4c05-9156-de4ae119ac3c] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:56:06.426307 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-6d627de3-cca6-4c18-bd15-567fe2ab5f2d tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:06.426747 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-6d627de3-cca6-4c18-bd15-567fe2ab5f2d tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:06.427509 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-6d627de3-cca6-4c18-bd15-567fe2ab5f2d tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:06.427942 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-6d627de3-cca6-4c18-bd15-567fe2ab5f2d tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:06.451095 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-da66ec15-4b97-4f82-90df-a1ddb8f8169a tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:56:06.451694 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-da66ec15-4b97-4f82-90df-a1ddb8f8169a tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] [instance: 7f3fde81-3f47-4590-ad2e-330bd31ed1f7] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:56:06.457727 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-da66ec15-4b97-4f82-90df-a1ddb8f8169a tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:06.458176 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-da66ec15-4b97-4f82-90df-a1ddb8f8169a tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:06.458934 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-da66ec15-4b97-4f82-90df-a1ddb8f8169a tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:06.459363 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-da66ec15-4b97-4f82-90df-a1ddb8f8169a tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:06.560448 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-6d627de3-cca6-4c18-bd15-567fe2ab5f2d tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7277aedb35df448e8b3056f8bc395e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c876091609fe45ba80370a16748cbeb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:56:06.567967 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-6d627de3-cca6-4c18-bd15-567fe2ab5f2d tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] 10.222.0.41 "GET /compute/v2.1/servers/d1efb756-8e30-4c05-9156-de4ae119ac3c" status: 200 len: 1556 microversion: 2.1 time: 0.152985 May 26 12:56:06.568724 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 463/927] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:56:06 2022] GET /compute/v2.1/servers/d1efb756-8e30-4c05-9156-de4ae119ac3c => generated 1556 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:56:06.743448 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.objects.instance [None req-da66ec15-4b97-4f82-90df-a1ddb8f8169a tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lazy-loading 'services' on Instance uuid 7f3fde81-3f47-4590-ad2e-330bd31ed1f7 {{(pid=124824) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:56:07.046080 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-da66ec15-4b97-4f82-90df-a1ddb8f8169a tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] 10.222.0.41 "DELETE /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7/os-volume_attachments/459dc9e5-0f2c-4bc1-ab8f-c3acb146695e" status: 202 len: 0 microversion: 2.1 time: 0.599157 May 26 12:56:07.046683 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 465/928] 10.222.0.41 () {58 vars in 1415 bytes} [Thu May 26 12:56:06 2022] DELETE /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7/os-volume_attachments/459dc9e5-0f2c-4bc1-ab8f-c3acb146695e => generated 0 bytes in 601 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 26 12:56:07.586536 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-d08464cb-e296-4554-8e44-5c3276e94f31 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:56:07.587157 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-d08464cb-e296-4554-8e44-5c3276e94f31 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] [instance: d1efb756-8e30-4c05-9156-de4ae119ac3c] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:56:07.593965 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-d08464cb-e296-4554-8e44-5c3276e94f31 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:07.594411 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-d08464cb-e296-4554-8e44-5c3276e94f31 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:07.595167 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-d08464cb-e296-4554-8e44-5c3276e94f31 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:07.595596 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-d08464cb-e296-4554-8e44-5c3276e94f31 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:07.723688 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-d08464cb-e296-4554-8e44-5c3276e94f31 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7277aedb35df448e8b3056f8bc395e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c876091609fe45ba80370a16748cbeb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:56:07.731861 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-d08464cb-e296-4554-8e44-5c3276e94f31 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] 10.222.0.41 "GET /compute/v2.1/servers/d1efb756-8e30-4c05-9156-de4ae119ac3c" status: 200 len: 1556 microversion: 2.1 time: 0.149887 May 26 12:56:07.732437 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 464/929] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:56:07 2022] GET /compute/v2.1/servers/d1efb756-8e30-4c05-9156-de4ae119ac3c => generated 1556 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:56:07.956678 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 12:56:07.963186 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Thu May 26 12:56:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 12:56:08.751154 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-3b62ecdf-66f4-4fac-a892-e9b2b159993c tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:56:08.751865 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-3b62ecdf-66f4-4fac-a892-e9b2b159993c tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] [instance: d1efb756-8e30-4c05-9156-de4ae119ac3c] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:56:08.758699 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-3b62ecdf-66f4-4fac-a892-e9b2b159993c tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:08.759155 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-3b62ecdf-66f4-4fac-a892-e9b2b159993c tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:08.759927 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-3b62ecdf-66f4-4fac-a892-e9b2b159993c tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:08.760371 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-3b62ecdf-66f4-4fac-a892-e9b2b159993c tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:08.896845 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-3b62ecdf-66f4-4fac-a892-e9b2b159993c tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7277aedb35df448e8b3056f8bc395e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c876091609fe45ba80370a16748cbeb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:56:08.905226 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-3b62ecdf-66f4-4fac-a892-e9b2b159993c tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] 10.222.0.41 "GET /compute/v2.1/servers/d1efb756-8e30-4c05-9156-de4ae119ac3c" status: 200 len: 1556 microversion: 2.1 time: 0.160051 May 26 12:56:08.906958 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 466/930] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:56:08 2022] GET /compute/v2.1/servers/d1efb756-8e30-4c05-9156-de4ae119ac3c => generated 1556 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:56:09.595019 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [req-4114c924-aef8-44ae-9432-c5ae5b166c82 req-23e5b95e-7c11-4b97-b5bb-0b826b97a03b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1efb756-8e30-4c05-9156-de4ae119ac3c", "name": "network-vif-deleted", "tag": "114a1a6a-836f-4257-81d6-756de175e28e"}]} {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:56:09.604174 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [req-4114c924-aef8-44ae-9432-c5ae5b166c82 req-23e5b95e-7c11-4b97-b5bb-0b826b97a03b service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:09.604609 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [req-4114c924-aef8-44ae-9432-c5ae5b166c82 req-23e5b95e-7c11-4b97-b5bb-0b826b97a03b service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:09.615573 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.compute.server_external_events [req-4114c924-aef8-44ae-9432-c5ae5b166c82 req-23e5b95e-7c11-4b97-b5bb-0b826b97a03b service nova] Creating event network-vif-deleted:114a1a6a-836f-4257-81d6-756de175e28e for instance d1efb756-8e30-4c05-9156-de4ae119ac3c on hv-cinder-81571 May 26 12:56:09.621550 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [req-4114c924-aef8-44ae-9432-c5ae5b166c82 req-23e5b95e-7c11-4b97-b5bb-0b826b97a03b service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031764 May 26 12:56:09.626565 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 465/931] 10.222.0.41 () {64 vars in 1317 bytes} [Thu May 26 12:56:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:56:09.922372 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-b3d90579-2337-49f2-bac4-8b9f26d2a349 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:56:09.923228 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-b3d90579-2337-49f2-bac4-8b9f26d2a349 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] [instance: d1efb756-8e30-4c05-9156-de4ae119ac3c] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:56:09.930593 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-b3d90579-2337-49f2-bac4-8b9f26d2a349 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:09.930927 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-b3d90579-2337-49f2-bac4-8b9f26d2a349 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:09.931705 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-b3d90579-2337-49f2-bac4-8b9f26d2a349 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:09.932157 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-b3d90579-2337-49f2-bac4-8b9f26d2a349 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:09.966423 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-b3d90579-2337-49f2-bac4-8b9f26d2a349 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:09.967093 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-b3d90579-2337-49f2-bac4-8b9f26d2a349 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:09.967708 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.objects.instance [None req-b3d90579-2337-49f2-bac4-8b9f26d2a349 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lazy-loading 'fault' on Instance uuid d1efb756-8e30-4c05-9156-de4ae119ac3c {{(pid=124824) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:56:10.016867 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-b3d90579-2337-49f2-bac4-8b9f26d2a349 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7277aedb35df448e8b3056f8bc395e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c876091609fe45ba80370a16748cbeb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:56:10.025581 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-b3d90579-2337-49f2-bac4-8b9f26d2a349 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] 10.222.0.41 "GET /compute/v2.1/servers/d1efb756-8e30-4c05-9156-de4ae119ac3c" status: 200 len: 1349 microversion: 2.1 time: 0.107109 May 26 12:56:10.026370 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 467/932] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:56:09 2022] GET /compute/v2.1/servers/d1efb756-8e30-4c05-9156-de4ae119ac3c => generated 1349 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:56:10.277980 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-bf4ddf66-4ba8-4f09-9175-a160a57931fe tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:56:10.284318 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-bf4ddf66-4ba8-4f09-9175-a160a57931fe tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:10.284765 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-bf4ddf66-4ba8-4f09-9175-a160a57931fe tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:10.306557 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-bf4ddf66-4ba8-4f09-9175-a160a57931fe tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] [instance: 7f3fde81-3f47-4590-ad2e-330bd31ed1f7] Going to try to stop instance {{(pid=124823) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 26 12:56:10.506816 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-bf4ddf66-4ba8-4f09-9175-a160a57931fe tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] 10.222.0.41 "POST /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7/action" status: 202 len: 0 microversion: 2.1 time: 0.233968 May 26 12:56:10.507384 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 466/933] 10.222.0.41 () {60 vars in 1277 bytes} [Thu May 26 12:56:10 2022] POST /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7/action => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 12:56:10.516261 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-9a0c50fd-ca47-4bb5-9502-94e1ec83c1c0 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:56:10.516879 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-9a0c50fd-ca47-4bb5-9502-94e1ec83c1c0 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] [instance: 7f3fde81-3f47-4590-ad2e-330bd31ed1f7] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:56:10.523014 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-9a0c50fd-ca47-4bb5-9502-94e1ec83c1c0 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:10.523458 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-9a0c50fd-ca47-4bb5-9502-94e1ec83c1c0 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:10.524210 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-9a0c50fd-ca47-4bb5-9502-94e1ec83c1c0 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:10.524644 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-9a0c50fd-ca47-4bb5-9502-94e1ec83c1c0 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:10.653839 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-9a0c50fd-ca47-4bb5-9502-94e1ec83c1c0 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa52505a079041efbbf14fb04da7ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe580a28eae4195be1491ac29d373a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:56:10.661376 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-9a0c50fd-ca47-4bb5-9502-94e1ec83c1c0 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] 10.222.0.41 "GET /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7" status: 200 len: 1678 microversion: 2.1 time: 0.149027 May 26 12:56:10.661977 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 468/934] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:56:10 2022] GET /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7 => generated 1678 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:56:11.044058 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-e2288496-7b59-4308-b108-1d0502dea953 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:56:11.044755 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-e2288496-7b59-4308-b108-1d0502dea953 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] [instance: d1efb756-8e30-4c05-9156-de4ae119ac3c] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:56:11.051399 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-e2288496-7b59-4308-b108-1d0502dea953 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:11.051839 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-e2288496-7b59-4308-b108-1d0502dea953 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:11.052591 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-e2288496-7b59-4308-b108-1d0502dea953 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:11.053048 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-e2288496-7b59-4308-b108-1d0502dea953 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:11.086500 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-e2288496-7b59-4308-b108-1d0502dea953 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:11.086957 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-e2288496-7b59-4308-b108-1d0502dea953 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:11.087406 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.objects.instance [None req-e2288496-7b59-4308-b108-1d0502dea953 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lazy-loading 'fault' on Instance uuid d1efb756-8e30-4c05-9156-de4ae119ac3c {{(pid=124823) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:56:11.131742 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-e2288496-7b59-4308-b108-1d0502dea953 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7277aedb35df448e8b3056f8bc395e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c876091609fe45ba80370a16748cbeb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:56:11.138491 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-e2288496-7b59-4308-b108-1d0502dea953 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] 10.222.0.41 "GET /compute/v2.1/servers/d1efb756-8e30-4c05-9156-de4ae119ac3c" status: 200 len: 1349 microversion: 2.1 time: 0.099337 May 26 12:56:11.139181 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 467/935] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:56:11 2022] GET /compute/v2.1/servers/d1efb756-8e30-4c05-9156-de4ae119ac3c => generated 1349 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:56:11.678697 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-f963abc2-d58a-4396-92ad-b9f5ef69f6f5 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:56:11.679308 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-f963abc2-d58a-4396-92ad-b9f5ef69f6f5 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] [instance: 7f3fde81-3f47-4590-ad2e-330bd31ed1f7] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:56:11.685815 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-f963abc2-d58a-4396-92ad-b9f5ef69f6f5 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:11.686261 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-f963abc2-d58a-4396-92ad-b9f5ef69f6f5 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:11.687030 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-f963abc2-d58a-4396-92ad-b9f5ef69f6f5 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:11.687461 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-f963abc2-d58a-4396-92ad-b9f5ef69f6f5 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:11.814761 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-f963abc2-d58a-4396-92ad-b9f5ef69f6f5 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa52505a079041efbbf14fb04da7ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe580a28eae4195be1491ac29d373a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:56:11.822953 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-f963abc2-d58a-4396-92ad-b9f5ef69f6f5 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] 10.222.0.41 "GET /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7" status: 200 len: 1678 microversion: 2.1 time: 0.148304 May 26 12:56:11.823524 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 469/936] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:56:11 2022] GET /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7 => generated 1678 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:56:12.154950 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-be18d818-ce5c-4729-9408-61e4d76f2bc7 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:56:12.155577 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-be18d818-ce5c-4729-9408-61e4d76f2bc7 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] [instance: d1efb756-8e30-4c05-9156-de4ae119ac3c] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:56:12.162154 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-be18d818-ce5c-4729-9408-61e4d76f2bc7 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:12.162596 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-be18d818-ce5c-4729-9408-61e4d76f2bc7 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:12.163349 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-be18d818-ce5c-4729-9408-61e4d76f2bc7 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:12.163778 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-be18d818-ce5c-4729-9408-61e4d76f2bc7 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:12.193818 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-be18d818-ce5c-4729-9408-61e4d76f2bc7 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:12.194264 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-be18d818-ce5c-4729-9408-61e4d76f2bc7 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:12.194711 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.objects.instance [None req-be18d818-ce5c-4729-9408-61e4d76f2bc7 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lazy-loading 'fault' on Instance uuid d1efb756-8e30-4c05-9156-de4ae119ac3c {{(pid=124823) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:56:12.234608 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-be18d818-ce5c-4729-9408-61e4d76f2bc7 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7277aedb35df448e8b3056f8bc395e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c876091609fe45ba80370a16748cbeb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:56:12.242471 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-be18d818-ce5c-4729-9408-61e4d76f2bc7 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] 10.222.0.41 "GET /compute/v2.1/servers/d1efb756-8e30-4c05-9156-de4ae119ac3c" status: 200 len: 1349 microversion: 2.1 time: 0.090987 May 26 12:56:12.243030 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 468/937] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:56:12 2022] GET /compute/v2.1/servers/d1efb756-8e30-4c05-9156-de4ae119ac3c => generated 1349 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:56:12.840993 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-5f27ee28-1a34-4990-affb-a6477696fa1f tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:56:12.841639 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-5f27ee28-1a34-4990-affb-a6477696fa1f tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] [instance: 7f3fde81-3f47-4590-ad2e-330bd31ed1f7] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:56:12.848494 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-5f27ee28-1a34-4990-affb-a6477696fa1f tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:12.848941 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-5f27ee28-1a34-4990-affb-a6477696fa1f tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:12.849746 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-5f27ee28-1a34-4990-affb-a6477696fa1f tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:12.850191 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-5f27ee28-1a34-4990-affb-a6477696fa1f tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:12.981458 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-5f27ee28-1a34-4990-affb-a6477696fa1f tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa52505a079041efbbf14fb04da7ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe580a28eae4195be1491ac29d373a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:56:12.990266 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-5f27ee28-1a34-4990-affb-a6477696fa1f tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] 10.222.0.41 "GET /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7" status: 200 len: 1678 microversion: 2.1 time: 0.153142 May 26 12:56:12.990850 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 470/938] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:56:12 2022] GET /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:56:13.260336 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-5181a5b9-1254-4b6f-851b-bda7846abead tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:56:13.260948 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-5181a5b9-1254-4b6f-851b-bda7846abead tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] [instance: d1efb756-8e30-4c05-9156-de4ae119ac3c] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:56:13.267991 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-5181a5b9-1254-4b6f-851b-bda7846abead tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:13.268448 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-5181a5b9-1254-4b6f-851b-bda7846abead tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:13.269526 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-5181a5b9-1254-4b6f-851b-bda7846abead tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:13.269940 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-5181a5b9-1254-4b6f-851b-bda7846abead tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:13.284296 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.wsgi [None req-5181a5b9-1254-4b6f-851b-bda7846abead tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] HTTP exception thrown: Instance d1efb756-8e30-4c05-9156-de4ae119ac3c could not be found. May 26 12:56:13.285981 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-5181a5b9-1254-4b6f-851b-bda7846abead tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Request method failure captured: May 26 12:56:13.285981 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: request: GET /compute/v2.1/servers/d1efb756-8e30-4c05-9156-de4ae119ac3c HTTP/1.1 May 26 12:56:13.285981 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Accept: application/json May 26 12:56:13.285981 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Accept-Encoding: identity May 26 12:56:13.285981 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Connection: close May 26 12:56:13.285981 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Content-Length: 0 May 26 12:56:13.285981 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Content-Type: application/json May 26 12:56:13.285981 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Host: 10.222.0.41 May 26 12:56:13.285981 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Openstack-System-Scope: None May 26 12:56:13.285981 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: User-Agent: python-urllib3/1.26.9 May 26 12:56:13.285981 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Auth-Token: gAAAAABij3g7V6YUPwevldhTRNjDZ3071UY1Zo9P_HtNAUZF-gBxZVwVBfjzy3OukDFiXMEsKZ8bej0_1g-vBr3nvMaUmdevLEbcZBsi0_kpDEJj31KUJuqTETSIcmF-mQcWX7TQodm8YGTOaLlLTHGzmXO0veEA6BD3GSVokkErHW49YUv-88Q May 26 12:56:13.285981 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Domain-Id: None May 26 12:56:13.285981 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Domain-Name: None May 26 12:56:13.285981 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Identity-Status: Confirmed May 26 12:56:13.285981 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Is-Admin-Project: True May 26 12:56:13.285981 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Project-Domain-Id: default May 26 12:56:13.285981 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Project-Domain-Name: Default May 26 12:56:13.285981 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Project-Id: c876091609fe45ba80370a16748cbeb2 May 26 12:56:13.285981 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Project-Name: tempest-TestMinimumBasicScenario-767154556 May 26 12:56:13.285981 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Role: member,reader May 26 12:56:13.285981 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Roles: member,reader May 26 12:56:13.287648 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/c876091609fe45ba80370a16748cbeb2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/c876091609fe45ba80370a16748cbeb2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/c876091609fe45ba80370a16748cbeb2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_c876091609fe45ba80370a16748cbeb2", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 26 12:56:13.287648 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Tenant: tempest-TestMinimumBasicScenario-767154556 May 26 12:56:13.287648 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Tenant-Id: c876091609fe45ba80370a16748cbeb2 May 26 12:56:13.287648 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Tenant-Name: tempest-TestMinimumBasicScenario-767154556 May 26 12:56:13.287648 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User: tempest-TestMinimumBasicScenario-767154556-project May 26 12:56:13.287648 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User-Domain-Id: default May 26 12:56:13.287648 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User-Domain-Name: Default May 26 12:56:13.287648 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User-Id: 7277aedb35df448e8b3056f8bc395e32 May 26 12:56:13.287648 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User-Name: tempest-TestMinimumBasicScenario-767154556-project May 26 12:56:13.287648 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: method: > May 26 12:56:13.287648 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: exception: Instance d1efb756-8e30-4c05-9156-de4ae119ac3c could not be found. May 26 12:56:13.287648 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: action_args: {'id': 'd1efb756-8e30-4c05-9156-de4ae119ac3c'} May 26 12:56:13.289167 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:56:13.289167 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:56:13.289167 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:56:13.289167 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:56:13.289167 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:56:13.289167 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:56:13.289167 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:56:13.289167 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:56:13.289167 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:56:13.289167 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:56:13.289167 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1efb756-8e30-4c05-9156-de4ae119ac3c could not be found. May 26 12:56:13.289167 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:56:13.289167 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:56:13.289167 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:56:13.289167 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:56:13.289167 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:56:13.289167 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:56:13.289167 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:56:13.289167 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:56:13.289167 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:56:13.290874 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:56:13.290874 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 12:56:13.290874 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 12:56:13.290874 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:56:13.290874 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:56:13.290874 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:56:13.290874 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:56:13.290874 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1efb756-8e30-4c05-9156-de4ae119ac3c could not be found. May 26 12:56:13.290874 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:56:13.290874 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:56:13.290874 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:56:13.290874 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:56:13.290874 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:56:13.290874 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:56:13.290874 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:56:13.290874 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:56:13.290874 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1efb756-8e30-4c05-9156-de4ae119ac3c could not be found. May 26 12:56:13.290874 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:56:13.292334 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-5181a5b9-1254-4b6f-851b-bda7846abead tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Returning 404 to user: Instance d1efb756-8e30-4c05-9156-de4ae119ac3c could not be found. {{(pid=124823) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:56:13.292334 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-5181a5b9-1254-4b6f-851b-bda7846abead tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] 10.222.0.41 "GET /compute/v2.1/servers/d1efb756-8e30-4c05-9156-de4ae119ac3c" status: 404 len: 111 microversion: 2.1 time: 0.031637 May 26 12:56:13.292334 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 469/939] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:56:13 2022] GET /compute/v2.1/servers/d1efb756-8e30-4c05-9156-de4ae119ac3c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:56:13.296273 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-cb19d9ea-d8f6-4909-8b96-d70006770b87 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] Calling method '.version_select at 0x7f26a1e0a160>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:56:13.396285 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-cb19d9ea-d8f6-4909-8b96-d70006770b87 tempest-TestMinimumBasicScenario-767154556 tempest-TestMinimumBasicScenario-767154556-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2109058780" status: 202 len: 0 microversion: 2.1 time: 0.103882 May 26 12:56:13.397062 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 471/940] 10.222.0.41 () {58 vars in 1271 bytes} [Thu May 26 12:56:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2109058780 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 12:56:14.007858 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-5d37ef2f-b6b6-4ba1-b6f6-b29469954c3d tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:56:14.008475 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-5d37ef2f-b6b6-4ba1-b6f6-b29469954c3d tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] [instance: 7f3fde81-3f47-4590-ad2e-330bd31ed1f7] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:56:14.014609 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-5d37ef2f-b6b6-4ba1-b6f6-b29469954c3d tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:14.017910 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-5d37ef2f-b6b6-4ba1-b6f6-b29469954c3d tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:14.017910 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-5d37ef2f-b6b6-4ba1-b6f6-b29469954c3d tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:14.017910 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-5d37ef2f-b6b6-4ba1-b6f6-b29469954c3d tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:14.156540 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-5d37ef2f-b6b6-4ba1-b6f6-b29469954c3d tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa52505a079041efbbf14fb04da7ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe580a28eae4195be1491ac29d373a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:56:14.164550 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-5d37ef2f-b6b6-4ba1-b6f6-b29469954c3d tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] 10.222.0.41 "GET /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7" status: 200 len: 1678 microversion: 2.1 time: 0.160277 May 26 12:56:14.165284 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 470/941] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:56:14 2022] GET /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7 => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:56:15.183200 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-1c427692-d195-4ec1-b6e5-f01cb261854a tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:56:15.183851 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-1c427692-d195-4ec1-b6e5-f01cb261854a tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] [instance: 7f3fde81-3f47-4590-ad2e-330bd31ed1f7] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:56:15.190086 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-1c427692-d195-4ec1-b6e5-f01cb261854a tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:15.190548 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-1c427692-d195-4ec1-b6e5-f01cb261854a tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:15.191323 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-1c427692-d195-4ec1-b6e5-f01cb261854a tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:15.191771 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-1c427692-d195-4ec1-b6e5-f01cb261854a tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:15.435934 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-1c427692-d195-4ec1-b6e5-f01cb261854a tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa52505a079041efbbf14fb04da7ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe580a28eae4195be1491ac29d373a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:56:15.443683 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-1c427692-d195-4ec1-b6e5-f01cb261854a tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] 10.222.0.41 "GET /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7" status: 200 len: 1678 microversion: 2.1 time: 0.265477 May 26 12:56:15.444359 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 472/942] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:56:15 2022] GET /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7 => generated 1678 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:56:16.461050 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-680a1eb4-3e0c-41cb-8cb7-f783b98acd60 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:56:16.461787 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-680a1eb4-3e0c-41cb-8cb7-f783b98acd60 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] [instance: 7f3fde81-3f47-4590-ad2e-330bd31ed1f7] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:56:16.469148 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-680a1eb4-3e0c-41cb-8cb7-f783b98acd60 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:16.469607 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-680a1eb4-3e0c-41cb-8cb7-f783b98acd60 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:16.470626 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-680a1eb4-3e0c-41cb-8cb7-f783b98acd60 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:16.471147 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-680a1eb4-3e0c-41cb-8cb7-f783b98acd60 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:16.678651 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-680a1eb4-3e0c-41cb-8cb7-f783b98acd60 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa52505a079041efbbf14fb04da7ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe580a28eae4195be1491ac29d373a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:56:16.689532 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-680a1eb4-3e0c-41cb-8cb7-f783b98acd60 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] 10.222.0.41 "GET /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7" status: 200 len: 1678 microversion: 2.1 time: 0.230048 May 26 12:56:16.697982 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 471/943] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:56:16 2022] GET /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7 => generated 1678 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:56:17.238078 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 12:56:17.241296 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Thu May 26 12:56:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 12:56:17.558663 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-6c8cb6a0-dbf0-46c7-95c0-e7b775046587 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1640869009", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1054937962", "security_groups": [{"name": "tempest-secgroup-smoke-178378433"}], "block_device_mapping_v2": [{"uuid": "ae019e5d-1535-4322-8d2b-46b3aa287e97", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "597bf63d-63f6-4d8e-ac74-b0e435929cf3"}]}} {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:56:17.703570 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-b04da613-26af-49a9-80b9-3038c2d7bde3 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:56:17.704181 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-b04da613-26af-49a9-80b9-3038c2d7bde3 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] [instance: 7f3fde81-3f47-4590-ad2e-330bd31ed1f7] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:56:17.711659 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-b04da613-26af-49a9-80b9-3038c2d7bde3 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:17.712107 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-b04da613-26af-49a9-80b9-3038c2d7bde3 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:17.712876 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-b04da613-26af-49a9-80b9-3038c2d7bde3 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:17.713309 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-b04da613-26af-49a9-80b9-3038c2d7bde3 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:17.732771 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.network.neutron [None req-6c8cb6a0-dbf0-46c7-95c0-e7b775046587 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] validate_networks() for [('597bf63d-63f6-4d8e-ac74-b0e435929cf3', None, None, None, None, None)] {{(pid=124824) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 12:56:17.879609 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-b04da613-26af-49a9-80b9-3038c2d7bde3 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa52505a079041efbbf14fb04da7ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe580a28eae4195be1491ac29d373a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:56:17.888449 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-b04da613-26af-49a9-80b9-3038c2d7bde3 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] 10.222.0.41 "GET /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7" status: 200 len: 1678 microversion: 2.1 time: 0.188643 May 26 12:56:17.889031 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 472/944] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:56:17 2022] GET /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7 => generated 1678 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:56:18.284597 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.virt.hardware [None req-6c8cb6a0-dbf0-46c7-95c0-e7b775046587 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Flavor limits 0:0:0 {{(pid=124824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 12:56:18.284597 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.virt.hardware [None req-6c8cb6a0-dbf0-46c7-95c0-e7b775046587 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Image limits 0:0:0 {{(pid=124824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 12:56:18.284597 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.virt.hardware [None req-6c8cb6a0-dbf0-46c7-95c0-e7b775046587 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Flavor pref 0:0:0 {{(pid=124824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 12:56:18.284597 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.virt.hardware [None req-6c8cb6a0-dbf0-46c7-95c0-e7b775046587 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Image pref 0:0:0 {{(pid=124824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 12:56:18.284597 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.virt.hardware [None req-6c8cb6a0-dbf0-46c7-95c0-e7b775046587 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 12:56:18.294976 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-6c8cb6a0-dbf0-46c7-95c0-e7b775046587 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:18.295491 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-6c8cb6a0-dbf0-46c7-95c0-e7b775046587 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:18.296353 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-6c8cb6a0-dbf0-46c7-95c0-e7b775046587 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:18.296886 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-6c8cb6a0-dbf0-46c7-95c0-e7b775046587 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:18.315270 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.quota [None req-6c8cb6a0-dbf0-46c7-95c0-e7b775046587 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Getting quotas for project 23568023763549669484e71430e34389. Resources: {'instances', 'ram', 'cores'} {{(pid=124824) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:56:18.319293 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.quota [None req-6c8cb6a0-dbf0-46c7-95c0-e7b775046587 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Getting quotas for user b47d51863b0448b880dc03b01dec6dc5 and project 23568023763549669484e71430e34389. Resources: {'instances', 'ram', 'cores'} {{(pid=124824) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:56:18.395340 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-6c8cb6a0-dbf0-46c7-95c0-e7b775046587 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Going to run 1 instances... {{(pid=124824) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 12:56:18.399523 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-6c8cb6a0-dbf0-46c7-95c0-e7b775046587 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] [instance: 6e0af4d0-3c35-4826-868b-6a60b7c7cb7b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ae019e5d-1535-4322-8d2b-46b3aa287e97',volume_size=None,volume_type=None)] {{(pid=124824) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 12:56:18.906699 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-f68d42dd-9f2f-4520-abe4-18c8b3f2b404 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:56:18.907318 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-f68d42dd-9f2f-4520-abe4-18c8b3f2b404 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] [instance: 7f3fde81-3f47-4590-ad2e-330bd31ed1f7] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:56:18.914039 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-f68d42dd-9f2f-4520-abe4-18c8b3f2b404 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:18.914500 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-f68d42dd-9f2f-4520-abe4-18c8b3f2b404 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:18.915273 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-f68d42dd-9f2f-4520-abe4-18c8b3f2b404 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:18.915710 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-f68d42dd-9f2f-4520-abe4-18c8b3f2b404 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:18.933604 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-6c8cb6a0-dbf0-46c7-95c0-e7b775046587 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.379938 May 26 12:56:18.934635 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 473/945] 10.222.0.41 () {60 vars in 1146 bytes} [Thu May 26 12:56:17 2022] POST /compute/v2.1/servers => generated 405 bytes in 1381 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 12:56:18.950372 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-02afc809-e3f6-45d5-8fae-a5e653bcabb6 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:56:18.951404 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-02afc809-e3f6-45d5-8fae-a5e653bcabb6 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] [instance: 6e0af4d0-3c35-4826-868b-6a60b7c7cb7b] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:56:19.029961 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-02afc809-e3f6-45d5-8fae-a5e653bcabb6 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47d51863b0448b880dc03b01dec6dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23568023763549669484e71430e34389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:56:19.041129 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-02afc809-e3f6-45d5-8fae-a5e653bcabb6 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] 10.222.0.41 "GET /compute/v2.1/servers/6e0af4d0-3c35-4826-868b-6a60b7c7cb7b" status: 200 len: 1095 microversion: 2.1 time: 0.100447 May 26 12:56:19.042751 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 474/946] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:56:18 2022] GET /compute/v2.1/servers/6e0af4d0-3c35-4826-868b-6a60b7c7cb7b => generated 1095 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:56:19.087318 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-f68d42dd-9f2f-4520-abe4-18c8b3f2b404 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa52505a079041efbbf14fb04da7ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe580a28eae4195be1491ac29d373a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:56:19.097272 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-f68d42dd-9f2f-4520-abe4-18c8b3f2b404 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] 10.222.0.41 "GET /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7" status: 200 len: 1678 microversion: 2.1 time: 0.192911 May 26 12:56:19.097895 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 473/947] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:56:18 2022] GET /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7 => generated 1678 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:56:20.058542 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-a7fd526e-f09d-4fd7-8fc9-00ca1a3670e8 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:56:20.059187 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-a7fd526e-f09d-4fd7-8fc9-00ca1a3670e8 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] [instance: 6e0af4d0-3c35-4826-868b-6a60b7c7cb7b] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:56:20.065926 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-a7fd526e-f09d-4fd7-8fc9-00ca1a3670e8 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:20.066381 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-a7fd526e-f09d-4fd7-8fc9-00ca1a3670e8 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:20.067979 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-a7fd526e-f09d-4fd7-8fc9-00ca1a3670e8 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:20.068137 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-a7fd526e-f09d-4fd7-8fc9-00ca1a3670e8 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:20.114550 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-4729278b-55ac-40b5-b074-1b75af2eb0d8 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:56:20.115255 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-4729278b-55ac-40b5-b074-1b75af2eb0d8 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] [instance: 7f3fde81-3f47-4590-ad2e-330bd31ed1f7] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:56:20.121738 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-4729278b-55ac-40b5-b074-1b75af2eb0d8 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:20.124550 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-4729278b-55ac-40b5-b074-1b75af2eb0d8 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:20.124550 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-4729278b-55ac-40b5-b074-1b75af2eb0d8 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:20.124550 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-4729278b-55ac-40b5-b074-1b75af2eb0d8 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:20.137495 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-a7fd526e-f09d-4fd7-8fc9-00ca1a3670e8 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47d51863b0448b880dc03b01dec6dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23568023763549669484e71430e34389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:56:20.145023 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-a7fd526e-f09d-4fd7-8fc9-00ca1a3670e8 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] 10.222.0.41 "GET /compute/v2.1/servers/6e0af4d0-3c35-4826-868b-6a60b7c7cb7b" status: 200 len: 1145 microversion: 2.1 time: 0.090417 May 26 12:56:20.145533 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 475/948] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:56:20 2022] GET /compute/v2.1/servers/6e0af4d0-3c35-4826-868b-6a60b7c7cb7b => generated 1145 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:56:20.279297 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-4729278b-55ac-40b5-b074-1b75af2eb0d8 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa52505a079041efbbf14fb04da7ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe580a28eae4195be1491ac29d373a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:56:20.283540 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG dbcounter [-] [124823] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:56:20.292662 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-4729278b-55ac-40b5-b074-1b75af2eb0d8 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] 10.222.0.41 "GET /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7" status: 200 len: 1678 microversion: 2.1 time: 0.181702 May 26 12:56:20.301713 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 474/949] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:56:20 2022] GET /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7 => generated 1678 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:56:21.166361 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-c0b51673-5cd3-4cd5-95cc-da131c6e1729 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:56:21.167591 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-c0b51673-5cd3-4cd5-95cc-da131c6e1729 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] [instance: 6e0af4d0-3c35-4826-868b-6a60b7c7cb7b] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:56:21.178017 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-c0b51673-5cd3-4cd5-95cc-da131c6e1729 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:21.179976 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-c0b51673-5cd3-4cd5-95cc-da131c6e1729 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:21.180969 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-c0b51673-5cd3-4cd5-95cc-da131c6e1729 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:21.181638 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-c0b51673-5cd3-4cd5-95cc-da131c6e1729 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:21.272725 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-c0b51673-5cd3-4cd5-95cc-da131c6e1729 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47d51863b0448b880dc03b01dec6dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23568023763549669484e71430e34389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:56:21.281144 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-c0b51673-5cd3-4cd5-95cc-da131c6e1729 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] 10.222.0.41 "GET /compute/v2.1/servers/6e0af4d0-3c35-4826-868b-6a60b7c7cb7b" status: 200 len: 1201 microversion: 2.1 time: 0.121831 May 26 12:56:21.285109 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 476/950] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:56:21 2022] GET /compute/v2.1/servers/6e0af4d0-3c35-4826-868b-6a60b7c7cb7b => generated 1201 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:56:21.312690 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-ca7564ac-c9a3-421f-9aa1-5a1029d29c61 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:56:21.314665 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-ca7564ac-c9a3-421f-9aa1-5a1029d29c61 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] [instance: 7f3fde81-3f47-4590-ad2e-330bd31ed1f7] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:56:21.322524 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-ca7564ac-c9a3-421f-9aa1-5a1029d29c61 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:21.324427 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-ca7564ac-c9a3-421f-9aa1-5a1029d29c61 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:21.324427 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-ca7564ac-c9a3-421f-9aa1-5a1029d29c61 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:21.324749 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-ca7564ac-c9a3-421f-9aa1-5a1029d29c61 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:21.544340 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-ca7564ac-c9a3-421f-9aa1-5a1029d29c61 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa52505a079041efbbf14fb04da7ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe580a28eae4195be1491ac29d373a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:56:21.552611 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-ca7564ac-c9a3-421f-9aa1-5a1029d29c61 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] 10.222.0.41 "GET /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7" status: 200 len: 1678 microversion: 2.1 time: 0.245266 May 26 12:56:21.553819 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 475/951] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:56:21 2022] GET /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7 => generated 1678 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:56:22.299093 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-c97188ad-3534-4fa5-8c3f-e0aa8a636ea9 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:56:22.300634 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-c97188ad-3534-4fa5-8c3f-e0aa8a636ea9 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] [instance: 6e0af4d0-3c35-4826-868b-6a60b7c7cb7b] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:56:22.312893 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-c97188ad-3534-4fa5-8c3f-e0aa8a636ea9 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:22.313987 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-c97188ad-3534-4fa5-8c3f-e0aa8a636ea9 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:22.316326 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-c97188ad-3534-4fa5-8c3f-e0aa8a636ea9 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:22.317267 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-c97188ad-3534-4fa5-8c3f-e0aa8a636ea9 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:22.571120 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-1778c017-befc-4131-9b68-a9ddb2f936fd tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:56:22.572370 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-1778c017-befc-4131-9b68-a9ddb2f936fd tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] [instance: 7f3fde81-3f47-4590-ad2e-330bd31ed1f7] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:56:22.583538 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-1778c017-befc-4131-9b68-a9ddb2f936fd tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:22.584261 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-1778c017-befc-4131-9b68-a9ddb2f936fd tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:22.585200 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-1778c017-befc-4131-9b68-a9ddb2f936fd tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:22.586451 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-1778c017-befc-4131-9b68-a9ddb2f936fd tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:22.787012 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-c97188ad-3534-4fa5-8c3f-e0aa8a636ea9 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47d51863b0448b880dc03b01dec6dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23568023763549669484e71430e34389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:56:22.791800 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG dbcounter [-] [124824] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=124824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:56:22.798405 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-c97188ad-3534-4fa5-8c3f-e0aa8a636ea9 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] 10.222.0.41 "GET /compute/v2.1/servers/6e0af4d0-3c35-4826-868b-6a60b7c7cb7b" status: 200 len: 1278 microversion: 2.1 time: 0.502841 May 26 12:56:22.799666 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 477/952] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:56:22 2022] GET /compute/v2.1/servers/6e0af4d0-3c35-4826-868b-6a60b7c7cb7b => generated 1278 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:56:22.823700 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-1778c017-befc-4131-9b68-a9ddb2f936fd tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa52505a079041efbbf14fb04da7ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe580a28eae4195be1491ac29d373a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:56:22.839587 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-1778c017-befc-4131-9b68-a9ddb2f936fd tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] 10.222.0.41 "GET /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7" status: 200 len: 1678 microversion: 2.1 time: 0.272979 May 26 12:56:22.849802 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 476/953] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:56:22 2022] GET /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7 => generated 1678 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:56:23.235861 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [req-ad864c8f-298a-4fe8-94ad-16cab9091e14 req-eca47422-fdd8-435e-bf1c-efea488213f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e0af4d0-3c35-4826-868b-6a60b7c7cb7b", "tag": "2b014596-4175-45bc-ae4e-056fcfa9a229"}]} {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:56:23.249069 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [req-ad864c8f-298a-4fe8-94ad-16cab9091e14 req-eca47422-fdd8-435e-bf1c-efea488213f6 service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:23.249759 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [req-ad864c8f-298a-4fe8-94ad-16cab9091e14 req-eca47422-fdd8-435e-bf1c-efea488213f6 service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:23.262445 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.compute.server_external_events [req-ad864c8f-298a-4fe8-94ad-16cab9091e14 req-eca47422-fdd8-435e-bf1c-efea488213f6 service nova] Creating event network-changed:2b014596-4175-45bc-ae4e-056fcfa9a229 for instance 6e0af4d0-3c35-4826-868b-6a60b7c7cb7b on hv-cinder-81571 May 26 12:56:23.271422 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [req-ad864c8f-298a-4fe8-94ad-16cab9091e14 req-eca47422-fdd8-435e-bf1c-efea488213f6 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039408 May 26 12:56:23.272082 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 478/954] 10.222.0.41 () {64 vars in 1317 bytes} [Thu May 26 12:56:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:56:23.821559 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-4423e6d7-710d-46c7-bf60-912495fe0b20 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:56:23.822368 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-4423e6d7-710d-46c7-bf60-912495fe0b20 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] [instance: 6e0af4d0-3c35-4826-868b-6a60b7c7cb7b] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:56:23.829555 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-4423e6d7-710d-46c7-bf60-912495fe0b20 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:23.833066 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-4423e6d7-710d-46c7-bf60-912495fe0b20 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:23.833066 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-4423e6d7-710d-46c7-bf60-912495fe0b20 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:23.833066 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-4423e6d7-710d-46c7-bf60-912495fe0b20 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:23.861871 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-465acd15-4591-4bce-a5af-4bef120a95d2 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:56:23.863984 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-465acd15-4591-4bce-a5af-4bef120a95d2 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] [instance: 7f3fde81-3f47-4590-ad2e-330bd31ed1f7] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:56:23.874616 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-465acd15-4591-4bce-a5af-4bef120a95d2 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:23.875416 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-465acd15-4591-4bce-a5af-4bef120a95d2 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:23.876584 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-465acd15-4591-4bce-a5af-4bef120a95d2 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:23.877910 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-465acd15-4591-4bce-a5af-4bef120a95d2 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:24.031544 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-465acd15-4591-4bce-a5af-4bef120a95d2 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa52505a079041efbbf14fb04da7ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe580a28eae4195be1491ac29d373a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:56:24.039192 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-465acd15-4591-4bce-a5af-4bef120a95d2 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] 10.222.0.41 "GET /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7" status: 200 len: 1655 microversion: 2.1 time: 0.185657 May 26 12:56:24.039825 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 479/955] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:56:23 2022] GET /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7 => generated 1655 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:56:24.055952 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-68c5478a-7a44-4a5c-99a1-625913ae33d2 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:56:24.062442 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-68c5478a-7a44-4a5c-99a1-625913ae33d2 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:24.062889 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-68c5478a-7a44-4a5c-99a1-625913ae33d2 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:24.064629 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-4423e6d7-710d-46c7-bf60-912495fe0b20 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47d51863b0448b880dc03b01dec6dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23568023763549669484e71430e34389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:56:24.073597 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-4423e6d7-710d-46c7-bf60-912495fe0b20 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] 10.222.0.41 "GET /compute/v2.1/servers/6e0af4d0-3c35-4826-868b-6a60b7c7cb7b" status: 200 len: 1266 microversion: 2.1 time: 0.256185 May 26 12:56:24.074642 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 477/956] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:56:23 2022] GET /compute/v2.1/servers/6e0af4d0-3c35-4826-868b-6a60b7c7cb7b => generated 1266 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:56:24.089848 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-68c5478a-7a44-4a5c-99a1-625913ae33d2 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] [instance: 7f3fde81-3f47-4590-ad2e-330bd31ed1f7] Going to try to start instance {{(pid=124824) start /opt/stack/nova/nova/compute/api.py:2730}} May 26 12:56:24.300080 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-68c5478a-7a44-4a5c-99a1-625913ae33d2 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] 10.222.0.41 "POST /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7/action" status: 202 len: 0 microversion: 2.1 time: 0.247925 May 26 12:56:24.300682 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 480/957] 10.222.0.41 () {60 vars in 1277 bytes} [Thu May 26 12:56:24 2022] POST /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7/action => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 26 12:56:24.314945 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-7dc5a43f-4273-4872-8190-b77205d17f4e tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:56:24.315555 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-7dc5a43f-4273-4872-8190-b77205d17f4e tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] [instance: 7f3fde81-3f47-4590-ad2e-330bd31ed1f7] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:56:24.322395 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-7dc5a43f-4273-4872-8190-b77205d17f4e tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:24.322844 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-7dc5a43f-4273-4872-8190-b77205d17f4e tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:24.323606 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-7dc5a43f-4273-4872-8190-b77205d17f4e tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:24.324037 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-7dc5a43f-4273-4872-8190-b77205d17f4e tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:24.705365 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-7dc5a43f-4273-4872-8190-b77205d17f4e tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa52505a079041efbbf14fb04da7ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe580a28eae4195be1491ac29d373a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:56:24.713005 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-7dc5a43f-4273-4872-8190-b77205d17f4e tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] 10.222.0.41 "GET /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7" status: 200 len: 1664 microversion: 2.1 time: 0.401942 May 26 12:56:24.713588 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 478/958] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:56:24 2022] GET /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7 => generated 1664 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:56:25.092223 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-07fd5825-445d-4a19-b2f5-c1c3eb77e837 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:56:25.092924 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-07fd5825-445d-4a19-b2f5-c1c3eb77e837 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] [instance: 6e0af4d0-3c35-4826-868b-6a60b7c7cb7b] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:56:25.099451 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-07fd5825-445d-4a19-b2f5-c1c3eb77e837 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:25.101646 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-07fd5825-445d-4a19-b2f5-c1c3eb77e837 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:25.101646 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-07fd5825-445d-4a19-b2f5-c1c3eb77e837 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:25.101646 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-07fd5825-445d-4a19-b2f5-c1c3eb77e837 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:25.260066 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-07fd5825-445d-4a19-b2f5-c1c3eb77e837 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47d51863b0448b880dc03b01dec6dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23568023763549669484e71430e34389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:56:25.267533 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-07fd5825-445d-4a19-b2f5-c1c3eb77e837 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] 10.222.0.41 "GET /compute/v2.1/servers/6e0af4d0-3c35-4826-868b-6a60b7c7cb7b" status: 200 len: 1266 microversion: 2.1 time: 0.179986 May 26 12:56:25.268103 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 481/959] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:56:25 2022] GET /compute/v2.1/servers/6e0af4d0-3c35-4826-868b-6a60b7c7cb7b => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:56:25.731004 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-6025a76b-10e1-4fe3-9837-b19a0fc71ca8 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:56:25.731515 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-6025a76b-10e1-4fe3-9837-b19a0fc71ca8 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] [instance: 7f3fde81-3f47-4590-ad2e-330bd31ed1f7] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:56:25.737858 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-6025a76b-10e1-4fe3-9837-b19a0fc71ca8 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:25.738307 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-6025a76b-10e1-4fe3-9837-b19a0fc71ca8 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:25.739078 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-6025a76b-10e1-4fe3-9837-b19a0fc71ca8 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:25.739526 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-6025a76b-10e1-4fe3-9837-b19a0fc71ca8 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:25.877596 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-6025a76b-10e1-4fe3-9837-b19a0fc71ca8 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa52505a079041efbbf14fb04da7ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe580a28eae4195be1491ac29d373a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:56:25.885841 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-6025a76b-10e1-4fe3-9837-b19a0fc71ca8 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] 10.222.0.41 "GET /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7" status: 200 len: 1664 microversion: 2.1 time: 0.159124 May 26 12:56:25.886509 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 479/960] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:56:25 2022] GET /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7 => generated 1664 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:56:26.284369 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-96ce4a06-e91e-47bf-bf9f-9e3915251fad tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:56:26.284916 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-96ce4a06-e91e-47bf-bf9f-9e3915251fad tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] [instance: 6e0af4d0-3c35-4826-868b-6a60b7c7cb7b] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:56:26.292420 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-96ce4a06-e91e-47bf-bf9f-9e3915251fad tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:26.292862 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-96ce4a06-e91e-47bf-bf9f-9e3915251fad tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:26.293628 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-96ce4a06-e91e-47bf-bf9f-9e3915251fad tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:26.294089 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-96ce4a06-e91e-47bf-bf9f-9e3915251fad tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:26.428280 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-96ce4a06-e91e-47bf-bf9f-9e3915251fad tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47d51863b0448b880dc03b01dec6dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23568023763549669484e71430e34389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:56:26.436677 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-96ce4a06-e91e-47bf-bf9f-9e3915251fad tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] 10.222.0.41 "GET /compute/v2.1/servers/6e0af4d0-3c35-4826-868b-6a60b7c7cb7b" status: 200 len: 1266 microversion: 2.1 time: 0.156217 May 26 12:56:26.437388 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 482/961] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:56:26 2022] GET /compute/v2.1/servers/6e0af4d0-3c35-4826-868b-6a60b7c7cb7b => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:56:26.903314 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-5af4efae-d57f-4954-87ca-68b2b91923f4 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:56:26.903863 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-5af4efae-d57f-4954-87ca-68b2b91923f4 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] [instance: 7f3fde81-3f47-4590-ad2e-330bd31ed1f7] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:56:26.910479 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-5af4efae-d57f-4954-87ca-68b2b91923f4 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:26.911052 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-5af4efae-d57f-4954-87ca-68b2b91923f4 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:26.911837 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-5af4efae-d57f-4954-87ca-68b2b91923f4 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:26.912261 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-5af4efae-d57f-4954-87ca-68b2b91923f4 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:27.055782 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-5af4efae-d57f-4954-87ca-68b2b91923f4 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa52505a079041efbbf14fb04da7ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe580a28eae4195be1491ac29d373a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:56:27.063416 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-5af4efae-d57f-4954-87ca-68b2b91923f4 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] 10.222.0.41 "GET /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7" status: 200 len: 1668 microversion: 2.1 time: 0.164087 May 26 12:56:27.063997 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 480/962] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:56:26 2022] GET /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7 => generated 1668 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:56:27.454085 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-5e115a12-a6ef-4d5c-a09b-4159bd9d9c3a tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:56:27.454658 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-5e115a12-a6ef-4d5c-a09b-4159bd9d9c3a tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] [instance: 6e0af4d0-3c35-4826-868b-6a60b7c7cb7b] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:56:27.462046 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-5e115a12-a6ef-4d5c-a09b-4159bd9d9c3a tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:27.462203 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-5e115a12-a6ef-4d5c-a09b-4159bd9d9c3a tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:27.463339 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-5e115a12-a6ef-4d5c-a09b-4159bd9d9c3a tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:27.463910 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-5e115a12-a6ef-4d5c-a09b-4159bd9d9c3a tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:27.606918 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-5e115a12-a6ef-4d5c-a09b-4159bd9d9c3a tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47d51863b0448b880dc03b01dec6dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23568023763549669484e71430e34389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:56:27.614644 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-5e115a12-a6ef-4d5c-a09b-4159bd9d9c3a tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] 10.222.0.41 "GET /compute/v2.1/servers/6e0af4d0-3c35-4826-868b-6a60b7c7cb7b" status: 200 len: 1266 microversion: 2.1 time: 0.164614 May 26 12:56:27.615218 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 483/963] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:56:27 2022] GET /compute/v2.1/servers/6e0af4d0-3c35-4826-868b-6a60b7c7cb7b => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:56:28.631759 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-f14826fe-ff53-4b97-aca6-c6c730894c6a tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:56:28.632917 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-f14826fe-ff53-4b97-aca6-c6c730894c6a tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] [instance: 6e0af4d0-3c35-4826-868b-6a60b7c7cb7b] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:56:28.639976 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-f14826fe-ff53-4b97-aca6-c6c730894c6a tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:28.640424 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-f14826fe-ff53-4b97-aca6-c6c730894c6a tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:28.641207 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-f14826fe-ff53-4b97-aca6-c6c730894c6a tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:28.641645 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-f14826fe-ff53-4b97-aca6-c6c730894c6a tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:28.815417 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-f14826fe-ff53-4b97-aca6-c6c730894c6a tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47d51863b0448b880dc03b01dec6dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23568023763549669484e71430e34389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:56:28.824464 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-f14826fe-ff53-4b97-aca6-c6c730894c6a tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] 10.222.0.41 "GET /compute/v2.1/servers/6e0af4d0-3c35-4826-868b-6a60b7c7cb7b" status: 200 len: 1266 microversion: 2.1 time: 0.196693 May 26 12:56:28.825058 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 481/964] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:56:28 2022] GET /compute/v2.1/servers/6e0af4d0-3c35-4826-868b-6a60b7c7cb7b => generated 1266 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:56:29.841266 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-ad0ba0ba-cf4a-40f0-b7dd-42aaeb95fc3e tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:56:29.841991 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-ad0ba0ba-cf4a-40f0-b7dd-42aaeb95fc3e tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] [instance: 6e0af4d0-3c35-4826-868b-6a60b7c7cb7b] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:56:29.844140 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG dbcounter [-] [124824] Writing DB stats nova_cell0:SELECT=2 {{(pid=124824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:56:29.845274 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG dbcounter [-] [124824] Writing DB stats nova_cell0:SELECT=8 {{(pid=124824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:56:29.850186 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-ad0ba0ba-cf4a-40f0-b7dd-42aaeb95fc3e tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:29.850631 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-ad0ba0ba-cf4a-40f0-b7dd-42aaeb95fc3e tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:29.852041 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-ad0ba0ba-cf4a-40f0-b7dd-42aaeb95fc3e tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:29.852468 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-ad0ba0ba-cf4a-40f0-b7dd-42aaeb95fc3e tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:29.990724 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-ad0ba0ba-cf4a-40f0-b7dd-42aaeb95fc3e tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47d51863b0448b880dc03b01dec6dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23568023763549669484e71430e34389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:56:29.998865 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-ad0ba0ba-cf4a-40f0-b7dd-42aaeb95fc3e tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] 10.222.0.41 "GET /compute/v2.1/servers/6e0af4d0-3c35-4826-868b-6a60b7c7cb7b" status: 200 len: 1266 microversion: 2.1 time: 0.161395 May 26 12:56:30.000349 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 484/965] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:56:29 2022] GET /compute/v2.1/servers/6e0af4d0-3c35-4826-868b-6a60b7c7cb7b => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:56:31.016781 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-b1563416-885f-449a-9cf5-f32066f90b48 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:56:31.017309 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-b1563416-885f-449a-9cf5-f32066f90b48 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] [instance: 6e0af4d0-3c35-4826-868b-6a60b7c7cb7b] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:56:31.019573 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG dbcounter [-] [124823] Writing DB stats nova_api:SELECT=51 {{(pid=124823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:56:31.024680 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-b1563416-885f-449a-9cf5-f32066f90b48 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:31.025136 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-b1563416-885f-449a-9cf5-f32066f90b48 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:31.025997 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-b1563416-885f-449a-9cf5-f32066f90b48 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:31.026432 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-b1563416-885f-449a-9cf5-f32066f90b48 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:31.193359 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-b1563416-885f-449a-9cf5-f32066f90b48 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47d51863b0448b880dc03b01dec6dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23568023763549669484e71430e34389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:56:31.201156 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-b1563416-885f-449a-9cf5-f32066f90b48 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] 10.222.0.41 "GET /compute/v2.1/servers/6e0af4d0-3c35-4826-868b-6a60b7c7cb7b" status: 200 len: 1266 microversion: 2.1 time: 0.188430 May 26 12:56:31.201827 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 482/966] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:56:31 2022] GET /compute/v2.1/servers/6e0af4d0-3c35-4826-868b-6a60b7c7cb7b => generated 1266 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:56:32.218977 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-93e0c11c-73fa-4154-8c11-acfee0bb1d32 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:56:32.219594 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-93e0c11c-73fa-4154-8c11-acfee0bb1d32 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] [instance: 6e0af4d0-3c35-4826-868b-6a60b7c7cb7b] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:56:32.226944 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-93e0c11c-73fa-4154-8c11-acfee0bb1d32 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:32.227399 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-93e0c11c-73fa-4154-8c11-acfee0bb1d32 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:32.228164 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-93e0c11c-73fa-4154-8c11-acfee0bb1d32 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:32.228585 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-93e0c11c-73fa-4154-8c11-acfee0bb1d32 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:32.378325 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-93e0c11c-73fa-4154-8c11-acfee0bb1d32 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47d51863b0448b880dc03b01dec6dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23568023763549669484e71430e34389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:56:32.387975 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-93e0c11c-73fa-4154-8c11-acfee0bb1d32 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] 10.222.0.41 "GET /compute/v2.1/servers/6e0af4d0-3c35-4826-868b-6a60b7c7cb7b" status: 200 len: 1266 microversion: 2.1 time: 0.173090 May 26 12:56:32.388560 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 485/967] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:56:32 2022] GET /compute/v2.1/servers/6e0af4d0-3c35-4826-868b-6a60b7c7cb7b => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:56:33.405953 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-d26c24de-5c35-4c83-a584-659e8cecf83f tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:56:33.407216 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-d26c24de-5c35-4c83-a584-659e8cecf83f tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] [instance: 6e0af4d0-3c35-4826-868b-6a60b7c7cb7b] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:56:33.414797 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-d26c24de-5c35-4c83-a584-659e8cecf83f tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:33.415546 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-d26c24de-5c35-4c83-a584-659e8cecf83f tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:33.416488 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-d26c24de-5c35-4c83-a584-659e8cecf83f tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:33.417085 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-d26c24de-5c35-4c83-a584-659e8cecf83f tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:33.568442 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-d26c24de-5c35-4c83-a584-659e8cecf83f tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47d51863b0448b880dc03b01dec6dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23568023763549669484e71430e34389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:56:33.577196 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-d26c24de-5c35-4c83-a584-659e8cecf83f tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] 10.222.0.41 "GET /compute/v2.1/servers/6e0af4d0-3c35-4826-868b-6a60b7c7cb7b" status: 200 len: 1266 microversion: 2.1 time: 0.175903 May 26 12:56:33.587095 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 483/968] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:56:33 2022] GET /compute/v2.1/servers/6e0af4d0-3c35-4826-868b-6a60b7c7cb7b => generated 1266 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:56:34.224206 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [req-20a48a91-a67a-4cc3-91c5-c19310fee2fe req-bb196293-60ad-49e9-a4c3-5507200b2616 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e0af4d0-3c35-4826-868b-6a60b7c7cb7b", "name": "network-vif-plugged", "status": "completed", "tag": "2b014596-4175-45bc-ae4e-056fcfa9a229"}]} {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:56:34.228376 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG dbcounter [-] [124824] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:56:34.233692 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [req-20a48a91-a67a-4cc3-91c5-c19310fee2fe req-bb196293-60ad-49e9-a4c3-5507200b2616 service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:34.234279 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [req-20a48a91-a67a-4cc3-91c5-c19310fee2fe req-bb196293-60ad-49e9-a4c3-5507200b2616 service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:34.246875 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.compute.server_external_events [req-20a48a91-a67a-4cc3-91c5-c19310fee2fe req-bb196293-60ad-49e9-a4c3-5507200b2616 service nova] Creating event network-vif-plugged:2b014596-4175-45bc-ae4e-056fcfa9a229 for instance 6e0af4d0-3c35-4826-868b-6a60b7c7cb7b on hv-cinder-81571 May 26 12:56:34.252336 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [req-20a48a91-a67a-4cc3-91c5-c19310fee2fe req-bb196293-60ad-49e9-a4c3-5507200b2616 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032197 May 26 12:56:34.252938 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 486/969] 10.222.0.41 () {64 vars in 1317 bytes} [Thu May 26 12:56:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:56:34.595519 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-2dd70950-218b-470e-80f1-cd56d8b777de tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:56:34.605226 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-2dd70950-218b-470e-80f1-cd56d8b777de tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] [instance: 6e0af4d0-3c35-4826-868b-6a60b7c7cb7b] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:56:34.621931 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-2dd70950-218b-470e-80f1-cd56d8b777de tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:34.622303 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-2dd70950-218b-470e-80f1-cd56d8b777de tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:34.623104 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-2dd70950-218b-470e-80f1-cd56d8b777de tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:34.623697 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-2dd70950-218b-470e-80f1-cd56d8b777de tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:34.894430 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-2dd70950-218b-470e-80f1-cd56d8b777de tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47d51863b0448b880dc03b01dec6dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23568023763549669484e71430e34389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:56:34.905340 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-2dd70950-218b-470e-80f1-cd56d8b777de tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] 10.222.0.41 "GET /compute/v2.1/servers/6e0af4d0-3c35-4826-868b-6a60b7c7cb7b" status: 200 len: 1266 microversion: 2.1 time: 0.313914 May 26 12:56:34.917968 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 484/970] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:56:34 2022] GET /compute/v2.1/servers/6e0af4d0-3c35-4826-868b-6a60b7c7cb7b => generated 1266 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:56:35.926267 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-79196d11-2506-4112-989a-d79021a18e8e tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:56:35.927984 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-79196d11-2506-4112-989a-d79021a18e8e tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] [instance: 6e0af4d0-3c35-4826-868b-6a60b7c7cb7b] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:56:35.935827 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-79196d11-2506-4112-989a-d79021a18e8e tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:35.937135 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-79196d11-2506-4112-989a-d79021a18e8e tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:35.939152 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-79196d11-2506-4112-989a-d79021a18e8e tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:35.939152 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-79196d11-2506-4112-989a-d79021a18e8e tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:36.163287 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-79196d11-2506-4112-989a-d79021a18e8e tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47d51863b0448b880dc03b01dec6dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23568023763549669484e71430e34389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:56:36.174810 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-79196d11-2506-4112-989a-d79021a18e8e tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] 10.222.0.41 "GET /compute/v2.1/servers/6e0af4d0-3c35-4826-868b-6a60b7c7cb7b" status: 200 len: 1266 microversion: 2.1 time: 0.254604 May 26 12:56:36.175410 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 487/971] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:56:35 2022] GET /compute/v2.1/servers/6e0af4d0-3c35-4826-868b-6a60b7c7cb7b => generated 1266 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:56:37.194478 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-5a168e23-1375-49da-88e4-18c4836256b0 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:56:37.197244 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-5a168e23-1375-49da-88e4-18c4836256b0 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] [instance: 6e0af4d0-3c35-4826-868b-6a60b7c7cb7b] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:56:37.208247 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-5a168e23-1375-49da-88e4-18c4836256b0 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:37.208881 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-5a168e23-1375-49da-88e4-18c4836256b0 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:37.211832 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-5a168e23-1375-49da-88e4-18c4836256b0 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:37.212496 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-5a168e23-1375-49da-88e4-18c4836256b0 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:37.390352 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-5a168e23-1375-49da-88e4-18c4836256b0 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47d51863b0448b880dc03b01dec6dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23568023763549669484e71430e34389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:56:37.399193 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-5a168e23-1375-49da-88e4-18c4836256b0 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] 10.222.0.41 "GET /compute/v2.1/servers/6e0af4d0-3c35-4826-868b-6a60b7c7cb7b" status: 200 len: 1453 microversion: 2.1 time: 0.210800 May 26 12:56:37.400002 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 485/972] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:56:37 2022] GET /compute/v2.1/servers/6e0af4d0-3c35-4826-868b-6a60b7c7cb7b => generated 1453 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:56:37.422077 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-30329378-af04-4427-b5d9-dd94bfa6f4b7 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:56:37.422808 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-30329378-af04-4427-b5d9-dd94bfa6f4b7 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] [instance: 6e0af4d0-3c35-4826-868b-6a60b7c7cb7b] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:56:37.434290 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-30329378-af04-4427-b5d9-dd94bfa6f4b7 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:37.434762 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-30329378-af04-4427-b5d9-dd94bfa6f4b7 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:37.440839 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-30329378-af04-4427-b5d9-dd94bfa6f4b7 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:37.441771 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-30329378-af04-4427-b5d9-dd94bfa6f4b7 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:37.680748 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-30329378-af04-4427-b5d9-dd94bfa6f4b7 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47d51863b0448b880dc03b01dec6dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23568023763549669484e71430e34389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:56:37.693640 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-30329378-af04-4427-b5d9-dd94bfa6f4b7 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] 10.222.0.41 "GET /compute/v2.1/servers/6e0af4d0-3c35-4826-868b-6a60b7c7cb7b" status: 200 len: 1453 microversion: 2.1 time: 0.281644 May 26 12:56:37.696135 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 488/973] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:56:37 2022] GET /compute/v2.1/servers/6e0af4d0-3c35-4826-868b-6a60b7c7cb7b => generated 1453 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:56:39.261036 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-b1ded977-63c3-4ad2-a64e-42c118ad3705 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Action: 'create', calling method: .version_select at 0x7f26a1f1bb80>, body: {"keypair": {"name": "tempest-TestShelveInstance-967223777", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7ViWu3orfhe+anVRNPGbTyZsdmX5TpvVFHDgSYgPVbGlhrBafM41QKtUqMIYrkBYqd8qVjAiFdXqssq7fD8xL31FmH923XKBZVHn6iUl0tmAB7k8RhGPPNKj1q6w9jLQ=="}} {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:56:39.276095 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.quota [None req-b1ded977-63c3-4ad2-a64e-42c118ad3705 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Getting quotas for project 0c2ea80ac0374c2c870a494adc6534ff. Resources: {'key_pairs'} {{(pid=124823) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:56:39.279981 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.quota [None req-b1ded977-63c3-4ad2-a64e-42c118ad3705 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Getting quotas for user e03ca4f264eb42ddbe92f5cb95d9fc2f and project 0c2ea80ac0374c2c870a494adc6534ff. Resources: {'key_pairs'} {{(pid=124823) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:56:39.379005 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-b1ded977-63c3-4ad2-a64e-42c118ad3705 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.327471 May 26 12:56:39.381379 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 486/974] 10.222.0.41 () {60 vars in 1158 bytes} [Thu May 26 12:56:39 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:56:40.254113 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [req-e4c89b44-aa9b-4e98-b0f2-895982d72375 req-d2cde1d5-429b-4e46-841b-894d99fe05ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e0af4d0-3c35-4826-868b-6a60b7c7cb7b", "tag": "2b014596-4175-45bc-ae4e-056fcfa9a229"}]} {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:56:40.263822 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [req-e4c89b44-aa9b-4e98-b0f2-895982d72375 req-d2cde1d5-429b-4e46-841b-894d99fe05ed service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:56:40.264362 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [req-e4c89b44-aa9b-4e98-b0f2-895982d72375 req-d2cde1d5-429b-4e46-841b-894d99fe05ed service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:56:40.275744 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.compute.server_external_events [req-e4c89b44-aa9b-4e98-b0f2-895982d72375 req-d2cde1d5-429b-4e46-841b-894d99fe05ed service nova] Creating event network-changed:2b014596-4175-45bc-ae4e-056fcfa9a229 for instance 6e0af4d0-3c35-4826-868b-6a60b7c7cb7b on hv-cinder-81571 May 26 12:56:40.281039 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [req-e4c89b44-aa9b-4e98-b0f2-895982d72375 req-d2cde1d5-429b-4e46-841b-894d99fe05ed service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030598 May 26 12:56:40.282199 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 489/975] 10.222.0.41 () {64 vars in 1317 bytes} [Thu May 26 12:56:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:57:00.352182 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG dbcounter [-] [124823] Writing DB stats nova_cell1:SELECT=66 {{(pid=124823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:57:00.352934 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG dbcounter [-] [124823] Writing DB stats nova_cell0:SELECT=4 {{(pid=124823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:57:00.353561 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG dbcounter [-] [124823] Writing DB stats nova_api:SELECT=18,nova_api:INSERT=1 {{(pid=124823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:57:00.357449 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-98cc60f8-045a-4bf9-aac5-77465027d496 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1247054464", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-967223777", "security_groups": [{"name": "tempest-secgroup-smoke-494100692"}], "networks": [{"uuid": "18057339-2e07-4e3b-a22d-79dac8c91ad1"}], "block_device_mapping_v2": [{"uuid": "c0a6c1ce-e79a-495c-8f70-f259c26db284", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:57:00.474325 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.network.neutron [None req-98cc60f8-045a-4bf9-aac5-77465027d496 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] validate_networks() for [('18057339-2e07-4e3b-a22d-79dac8c91ad1', None, None, None, None, None)] {{(pid=124823) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 12:57:00.835647 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.virt.hardware [None req-98cc60f8-045a-4bf9-aac5-77465027d496 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Flavor limits 0:0:0 {{(pid=124823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 12:57:00.836073 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.virt.hardware [None req-98cc60f8-045a-4bf9-aac5-77465027d496 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Image limits 0:0:0 {{(pid=124823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 12:57:00.836546 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.virt.hardware [None req-98cc60f8-045a-4bf9-aac5-77465027d496 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Flavor pref 0:0:0 {{(pid=124823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 12:57:00.836977 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.virt.hardware [None req-98cc60f8-045a-4bf9-aac5-77465027d496 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Image pref 0:0:0 {{(pid=124823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 12:57:00.837413 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.virt.hardware [None req-98cc60f8-045a-4bf9-aac5-77465027d496 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 12:57:00.846562 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-98cc60f8-045a-4bf9-aac5-77465027d496 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:00.853556 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-98cc60f8-045a-4bf9-aac5-77465027d496 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:00.853556 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-98cc60f8-045a-4bf9-aac5-77465027d496 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:00.853556 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-98cc60f8-045a-4bf9-aac5-77465027d496 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:00.864668 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.quota [None req-98cc60f8-045a-4bf9-aac5-77465027d496 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Getting quotas for project 0c2ea80ac0374c2c870a494adc6534ff. Resources: {'instances', 'ram', 'cores'} {{(pid=124823) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:57:00.868851 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.quota [None req-98cc60f8-045a-4bf9-aac5-77465027d496 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Getting quotas for user e03ca4f264eb42ddbe92f5cb95d9fc2f and project 0c2ea80ac0374c2c870a494adc6534ff. Resources: {'instances', 'ram', 'cores'} {{(pid=124823) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:57:00.926498 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-98cc60f8-045a-4bf9-aac5-77465027d496 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Going to run 1 instances... {{(pid=124823) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 12:57:00.928680 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-98cc60f8-045a-4bf9-aac5-77465027d496 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] [instance: d3e49793-145c-4fea-979c-3875adb1ef35] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c0a6c1ce-e79a-495c-8f70-f259c26db284',volume_size=None,volume_type=None)] {{(pid=124823) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 12:57:01.394383 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-98cc60f8-045a-4bf9-aac5-77465027d496 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.043828 May 26 12:57:01.395358 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 487/976] 10.222.0.41 () {60 vars in 1146 bytes} [Thu May 26 12:57:00 2022] POST /compute/v2.1/servers => generated 405 bytes in 1045 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 12:57:01.413126 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-f4c9e6dc-4550-480b-ad0b-6c4bc6f0c5d1 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:57:01.414243 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-f4c9e6dc-4550-480b-ad0b-6c4bc6f0c5d1 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] [instance: d3e49793-145c-4fea-979c-3875adb1ef35] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:57:01.416462 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG dbcounter [-] [124824] Writing DB stats nova_api:SELECT=7 {{(pid=124824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:57:01.417122 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG dbcounter [-] [124824] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:57:01.469657 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-f4c9e6dc-4550-480b-ad0b-6c4bc6f0c5d1 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03ca4f264eb42ddbe92f5cb95d9fc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2ea80ac0374c2c870a494adc6534ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:01.476811 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-f4c9e6dc-4550-480b-ad0b-6c4bc6f0c5d1 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] 10.222.0.41 "GET /compute/v2.1/servers/d3e49793-145c-4fea-979c-3875adb1ef35" status: 200 len: 1088 microversion: 2.1 time: 0.068223 May 26 12:57:01.477396 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 490/977] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:57:01 2022] GET /compute/v2.1/servers/d3e49793-145c-4fea-979c-3875adb1ef35 => generated 1088 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:57:02.492954 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-46dbd011-0f04-4382-8fd0-0bfaf7196a9c tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:57:02.493626 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-46dbd011-0f04-4382-8fd0-0bfaf7196a9c tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] [instance: d3e49793-145c-4fea-979c-3875adb1ef35] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:57:02.546136 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-46dbd011-0f04-4382-8fd0-0bfaf7196a9c tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03ca4f264eb42ddbe92f5cb95d9fc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2ea80ac0374c2c870a494adc6534ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:02.552797 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-46dbd011-0f04-4382-8fd0-0bfaf7196a9c tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] 10.222.0.41 "GET /compute/v2.1/servers/d3e49793-145c-4fea-979c-3875adb1ef35" status: 200 len: 1088 microversion: 2.1 time: 0.063860 May 26 12:57:02.553357 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 488/978] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:57:02 2022] GET /compute/v2.1/servers/d3e49793-145c-4fea-979c-3875adb1ef35 => generated 1088 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:57:03.569877 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-ac55962a-cbaf-4bce-b771-f40b2b0db763 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:57:03.570486 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-ac55962a-cbaf-4bce-b771-f40b2b0db763 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] [instance: d3e49793-145c-4fea-979c-3875adb1ef35] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:57:03.578131 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-ac55962a-cbaf-4bce-b771-f40b2b0db763 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:03.578580 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-ac55962a-cbaf-4bce-b771-f40b2b0db763 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:03.579378 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-ac55962a-cbaf-4bce-b771-f40b2b0db763 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:03.579815 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-ac55962a-cbaf-4bce-b771-f40b2b0db763 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:03.644813 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-ac55962a-cbaf-4bce-b771-f40b2b0db763 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03ca4f264eb42ddbe92f5cb95d9fc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2ea80ac0374c2c870a494adc6534ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:03.652980 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-ac55962a-cbaf-4bce-b771-f40b2b0db763 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] 10.222.0.41 "GET /compute/v2.1/servers/d3e49793-145c-4fea-979c-3875adb1ef35" status: 200 len: 1186 microversion: 2.1 time: 0.087528 May 26 12:57:03.653544 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 491/979] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:57:03 2022] GET /compute/v2.1/servers/d3e49793-145c-4fea-979c-3875adb1ef35 => generated 1186 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:57:04.670613 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-ef8ebc4f-a1f0-4ea8-b6d8-0d6b388f773f tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:57:04.671419 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-ef8ebc4f-a1f0-4ea8-b6d8-0d6b388f773f tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] [instance: d3e49793-145c-4fea-979c-3875adb1ef35] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:57:04.678358 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-ef8ebc4f-a1f0-4ea8-b6d8-0d6b388f773f tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:04.682250 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-ef8ebc4f-a1f0-4ea8-b6d8-0d6b388f773f tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:04.682250 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-ef8ebc4f-a1f0-4ea8-b6d8-0d6b388f773f tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:04.682250 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-ef8ebc4f-a1f0-4ea8-b6d8-0d6b388f773f tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:04.781019 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-ef8ebc4f-a1f0-4ea8-b6d8-0d6b388f773f tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03ca4f264eb42ddbe92f5cb95d9fc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2ea80ac0374c2c870a494adc6534ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:04.789175 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-ef8ebc4f-a1f0-4ea8-b6d8-0d6b388f773f tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] 10.222.0.41 "GET /compute/v2.1/servers/d3e49793-145c-4fea-979c-3875adb1ef35" status: 200 len: 1204 microversion: 2.1 time: 0.123009 May 26 12:57:04.789774 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 489/980] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:57:04 2022] GET /compute/v2.1/servers/d3e49793-145c-4fea-979c-3875adb1ef35 => generated 1204 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:57:05.810666 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-057469ee-76b5-4544-8779-de44bbf7420d tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:57:05.811278 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-057469ee-76b5-4544-8779-de44bbf7420d tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] [instance: d3e49793-145c-4fea-979c-3875adb1ef35] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:57:05.823381 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-057469ee-76b5-4544-8779-de44bbf7420d tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:05.823381 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-057469ee-76b5-4544-8779-de44bbf7420d tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:05.823381 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-057469ee-76b5-4544-8779-de44bbf7420d tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:05.823381 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-057469ee-76b5-4544-8779-de44bbf7420d tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:05.937924 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [req-3241ea1b-0943-4b3c-ae73-310f0a2807d0 req-6730fc09-bde3-436d-a944-5b376dfb813e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3e49793-145c-4fea-979c-3875adb1ef35", "tag": "e52542b8-e1ca-485c-bbda-287934dde033"}]} {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:57:05.947643 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [req-3241ea1b-0943-4b3c-ae73-310f0a2807d0 req-6730fc09-bde3-436d-a944-5b376dfb813e service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:05.949086 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [req-3241ea1b-0943-4b3c-ae73-310f0a2807d0 req-6730fc09-bde3-436d-a944-5b376dfb813e service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:05.968267 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.compute.server_external_events [req-3241ea1b-0943-4b3c-ae73-310f0a2807d0 req-6730fc09-bde3-436d-a944-5b376dfb813e service nova] Creating event network-changed:e52542b8-e1ca-485c-bbda-287934dde033 for instance d3e49793-145c-4fea-979c-3875adb1ef35 on hv-cinder-81571 May 26 12:57:05.977234 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [req-3241ea1b-0943-4b3c-ae73-310f0a2807d0 req-6730fc09-bde3-436d-a944-5b376dfb813e service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045485 May 26 12:57:05.978130 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 490/981] 10.222.0.41 () {64 vars in 1317 bytes} [Thu May 26 12:57:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:57:05.983546 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-057469ee-76b5-4544-8779-de44bbf7420d tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03ca4f264eb42ddbe92f5cb95d9fc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2ea80ac0374c2c870a494adc6534ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:05.994065 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-057469ee-76b5-4544-8779-de44bbf7420d tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] 10.222.0.41 "GET /compute/v2.1/servers/d3e49793-145c-4fea-979c-3875adb1ef35" status: 200 len: 1259 microversion: 2.1 time: 0.187148 May 26 12:57:06.003441 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 492/982] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:57:05 2022] GET /compute/v2.1/servers/d3e49793-145c-4fea-979c-3875adb1ef35 => generated 1259 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:57:07.012028 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-af1f8eb0-8452-414f-8863-2b162116b579 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:57:07.012639 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-af1f8eb0-8452-414f-8863-2b162116b579 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] [instance: d3e49793-145c-4fea-979c-3875adb1ef35] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:57:07.018842 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-af1f8eb0-8452-414f-8863-2b162116b579 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:07.019295 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-af1f8eb0-8452-414f-8863-2b162116b579 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:07.020051 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-af1f8eb0-8452-414f-8863-2b162116b579 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:07.020484 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-af1f8eb0-8452-414f-8863-2b162116b579 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:07.164537 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-af1f8eb0-8452-414f-8863-2b162116b579 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03ca4f264eb42ddbe92f5cb95d9fc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2ea80ac0374c2c870a494adc6534ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:07.172138 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-af1f8eb0-8452-414f-8863-2b162116b579 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] 10.222.0.41 "GET /compute/v2.1/servers/d3e49793-145c-4fea-979c-3875adb1ef35" status: 200 len: 1259 microversion: 2.1 time: 0.164881 May 26 12:57:07.172709 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 491/983] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:57:07 2022] GET /compute/v2.1/servers/d3e49793-145c-4fea-979c-3875adb1ef35 => generated 1259 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:57:08.188440 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-c2e8b436-4ae9-4912-b070-a8bdd2a1f22b tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:57:08.189058 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-c2e8b436-4ae9-4912-b070-a8bdd2a1f22b tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] [instance: d3e49793-145c-4fea-979c-3875adb1ef35] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:57:08.196491 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-c2e8b436-4ae9-4912-b070-a8bdd2a1f22b tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:08.196942 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-c2e8b436-4ae9-4912-b070-a8bdd2a1f22b tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:08.197742 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-c2e8b436-4ae9-4912-b070-a8bdd2a1f22b tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:08.198183 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-c2e8b436-4ae9-4912-b070-a8bdd2a1f22b tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:08.329234 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-c2e8b436-4ae9-4912-b070-a8bdd2a1f22b tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03ca4f264eb42ddbe92f5cb95d9fc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2ea80ac0374c2c870a494adc6534ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:08.336786 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-c2e8b436-4ae9-4912-b070-a8bdd2a1f22b tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] 10.222.0.41 "GET /compute/v2.1/servers/d3e49793-145c-4fea-979c-3875adb1ef35" status: 200 len: 1259 microversion: 2.1 time: 0.152261 May 26 12:57:08.337360 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 493/984] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:57:08 2022] GET /compute/v2.1/servers/d3e49793-145c-4fea-979c-3875adb1ef35 => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:57:08.987710 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-529de3bd-4a35-4192-9c8c-bc69537112e4 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:57:08.988695 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-529de3bd-4a35-4192-9c8c-bc69537112e4 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] [instance: 7f3fde81-3f47-4590-ad2e-330bd31ed1f7] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:57:08.995296 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-529de3bd-4a35-4192-9c8c-bc69537112e4 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:08.995745 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-529de3bd-4a35-4192-9c8c-bc69537112e4 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:08.996512 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-529de3bd-4a35-4192-9c8c-bc69537112e4 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:08.996949 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-529de3bd-4a35-4192-9c8c-bc69537112e4 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:09.026890 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-529de3bd-4a35-4192-9c8c-bc69537112e4 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] 10.222.0.41 "GET /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043064 May 26 12:57:09.027454 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 492/985] 10.222.0.41 () {58 vars in 1301 bytes} [Thu May 26 12:57:08 2022] GET /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 12:57:09.093112 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-0fabb882-32e2-41ce-acae-44077315e400 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:57:09.093606 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-0fabb882-32e2-41ce-acae-44077315e400 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] [instance: 7f3fde81-3f47-4590-ad2e-330bd31ed1f7] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:57:09.099638 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-0fabb882-32e2-41ce-acae-44077315e400 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:09.100081 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-0fabb882-32e2-41ce-acae-44077315e400 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:09.100889 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-0fabb882-32e2-41ce-acae-44077315e400 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:09.101318 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-0fabb882-32e2-41ce-acae-44077315e400 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:09.125659 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-0fabb882-32e2-41ce-acae-44077315e400 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] [instance: 7f3fde81-3f47-4590-ad2e-330bd31ed1f7] Going to try to terminate instance {{(pid=124824) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 12:57:09.353646 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-47c08e3d-e1a7-418d-86d7-796042b12c14 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:57:09.354217 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-47c08e3d-e1a7-418d-86d7-796042b12c14 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] [instance: d3e49793-145c-4fea-979c-3875adb1ef35] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:57:09.360287 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-47c08e3d-e1a7-418d-86d7-796042b12c14 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:09.360741 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-47c08e3d-e1a7-418d-86d7-796042b12c14 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:09.361528 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-47c08e3d-e1a7-418d-86d7-796042b12c14 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:09.361978 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-47c08e3d-e1a7-418d-86d7-796042b12c14 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:09.496342 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-47c08e3d-e1a7-418d-86d7-796042b12c14 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03ca4f264eb42ddbe92f5cb95d9fc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2ea80ac0374c2c870a494adc6534ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:09.502451 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-0fabb882-32e2-41ce-acae-44077315e400 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] 10.222.0.41 "DELETE /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7" status: 204 len: 0 microversion: 2.1 time: 0.413218 May 26 12:57:09.503088 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 494/986] 10.222.0.41 () {58 vars in 1238 bytes} [Thu May 26 12:57:09 2022] DELETE /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 12:57:09.506175 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-47c08e3d-e1a7-418d-86d7-796042b12c14 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] 10.222.0.41 "GET /compute/v2.1/servers/d3e49793-145c-4fea-979c-3875adb1ef35" status: 200 len: 1259 microversion: 2.1 time: 0.154664 May 26 12:57:09.506175 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 493/987] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:57:09 2022] GET /compute/v2.1/servers/d3e49793-145c-4fea-979c-3875adb1ef35 => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:57:09.515917 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-93fcfd92-58fd-4d8c-a869-cbd49f409736 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:57:09.517918 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-93fcfd92-58fd-4d8c-a869-cbd49f409736 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] [instance: 7f3fde81-3f47-4590-ad2e-330bd31ed1f7] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:57:09.523055 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-93fcfd92-58fd-4d8c-a869-cbd49f409736 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:09.523501 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-93fcfd92-58fd-4d8c-a869-cbd49f409736 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:09.524275 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-93fcfd92-58fd-4d8c-a869-cbd49f409736 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:09.524710 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-93fcfd92-58fd-4d8c-a869-cbd49f409736 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:09.661484 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-93fcfd92-58fd-4d8c-a869-cbd49f409736 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa52505a079041efbbf14fb04da7ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe580a28eae4195be1491ac29d373a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:09.670927 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-93fcfd92-58fd-4d8c-a869-cbd49f409736 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] 10.222.0.41 "GET /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7" status: 200 len: 1674 microversion: 2.1 time: 0.159401 May 26 12:57:09.671507 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 495/988] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:57:09 2022] GET /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7 => generated 1674 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:57:10.522066 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-058c343e-229e-46b2-88ae-9dad740e776e tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:57:10.523994 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-058c343e-229e-46b2-88ae-9dad740e776e tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] [instance: d3e49793-145c-4fea-979c-3875adb1ef35] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:57:10.530307 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-058c343e-229e-46b2-88ae-9dad740e776e tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:10.530785 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-058c343e-229e-46b2-88ae-9dad740e776e tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:10.531567 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-058c343e-229e-46b2-88ae-9dad740e776e tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:10.532004 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-058c343e-229e-46b2-88ae-9dad740e776e tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:10.666259 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-058c343e-229e-46b2-88ae-9dad740e776e tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03ca4f264eb42ddbe92f5cb95d9fc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2ea80ac0374c2c870a494adc6534ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:10.673971 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-058c343e-229e-46b2-88ae-9dad740e776e tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] 10.222.0.41 "GET /compute/v2.1/servers/d3e49793-145c-4fea-979c-3875adb1ef35" status: 200 len: 1259 microversion: 2.1 time: 0.156076 May 26 12:57:10.674541 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 494/989] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:57:10 2022] GET /compute/v2.1/servers/d3e49793-145c-4fea-979c-3875adb1ef35 => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:57:10.688378 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-a6786bf1-bbd3-4c10-9325-448b93771570 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:57:10.688998 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-a6786bf1-bbd3-4c10-9325-448b93771570 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] [instance: 7f3fde81-3f47-4590-ad2e-330bd31ed1f7] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:57:10.695744 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-a6786bf1-bbd3-4c10-9325-448b93771570 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:10.696200 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-a6786bf1-bbd3-4c10-9325-448b93771570 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:10.696971 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-a6786bf1-bbd3-4c10-9325-448b93771570 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:10.697411 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-a6786bf1-bbd3-4c10-9325-448b93771570 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:10.827970 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-a6786bf1-bbd3-4c10-9325-448b93771570 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa52505a079041efbbf14fb04da7ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe580a28eae4195be1491ac29d373a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:10.836120 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-a6786bf1-bbd3-4c10-9325-448b93771570 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] 10.222.0.41 "GET /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7" status: 200 len: 1674 microversion: 2.1 time: 0.151762 May 26 12:57:10.836689 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 496/990] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:57:10 2022] GET /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7 => generated 1674 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:57:11.691249 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-cbd80c7e-d98e-433f-a0b1-336de655cc81 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:57:11.691885 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-cbd80c7e-d98e-433f-a0b1-336de655cc81 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] [instance: d3e49793-145c-4fea-979c-3875adb1ef35] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:57:11.695686 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG dbcounter [-] [124823] Writing DB stats nova_cell0:SELECT=2 {{(pid=124823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:57:11.700417 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-cbd80c7e-d98e-433f-a0b1-336de655cc81 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:11.701231 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-cbd80c7e-d98e-433f-a0b1-336de655cc81 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:11.702139 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-cbd80c7e-d98e-433f-a0b1-336de655cc81 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:11.702662 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-cbd80c7e-d98e-433f-a0b1-336de655cc81 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:11.854747 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-d21c5280-6d66-4d2c-8543-a85e5a072fc8 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:57:11.858794 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-d21c5280-6d66-4d2c-8543-a85e5a072fc8 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] [instance: 7f3fde81-3f47-4590-ad2e-330bd31ed1f7] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:57:11.860567 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG dbcounter [-] [124824] Writing DB stats nova_cell0:SELECT=2 {{(pid=124824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:57:11.865308 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-d21c5280-6d66-4d2c-8543-a85e5a072fc8 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:11.866721 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-d21c5280-6d66-4d2c-8543-a85e5a072fc8 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:11.867745 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-d21c5280-6d66-4d2c-8543-a85e5a072fc8 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:11.868381 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-d21c5280-6d66-4d2c-8543-a85e5a072fc8 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:12.063825 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-cbd80c7e-d98e-433f-a0b1-336de655cc81 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03ca4f264eb42ddbe92f5cb95d9fc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2ea80ac0374c2c870a494adc6534ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:12.082101 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-cbd80c7e-d98e-433f-a0b1-336de655cc81 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] 10.222.0.41 "GET /compute/v2.1/servers/d3e49793-145c-4fea-979c-3875adb1ef35" status: 200 len: 1259 microversion: 2.1 time: 0.392763 May 26 12:57:12.083700 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 495/991] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:57:11 2022] GET /compute/v2.1/servers/d3e49793-145c-4fea-979c-3875adb1ef35 => generated 1259 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:57:12.136277 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-d21c5280-6d66-4d2c-8543-a85e5a072fc8 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa52505a079041efbbf14fb04da7ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe580a28eae4195be1491ac29d373a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:12.145383 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-d21c5280-6d66-4d2c-8543-a85e5a072fc8 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] 10.222.0.41 "GET /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7" status: 200 len: 1674 microversion: 2.1 time: 0.295067 May 26 12:57:12.155818 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 497/992] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:57:11 2022] GET /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7 => generated 1674 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:57:12.181591 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [req-bc97bf7a-a797-4146-a0ac-3144ef292383 req-86505603-bd6e-4949-8ded-96a98f2fa3c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3e49793-145c-4fea-979c-3875adb1ef35", "name": "network-vif-plugged", "status": "completed", "tag": "e52542b8-e1ca-485c-bbda-287934dde033"}]} {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:57:12.191241 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [req-bc97bf7a-a797-4146-a0ac-3144ef292383 req-86505603-bd6e-4949-8ded-96a98f2fa3c4 service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:12.191794 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [req-bc97bf7a-a797-4146-a0ac-3144ef292383 req-86505603-bd6e-4949-8ded-96a98f2fa3c4 service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:12.204495 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.compute.server_external_events [req-bc97bf7a-a797-4146-a0ac-3144ef292383 req-86505603-bd6e-4949-8ded-96a98f2fa3c4 service nova] Creating event network-vif-plugged:e52542b8-e1ca-485c-bbda-287934dde033 for instance d3e49793-145c-4fea-979c-3875adb1ef35 on hv-cinder-81571 May 26 12:57:12.210465 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [req-bc97bf7a-a797-4146-a0ac-3144ef292383 req-86505603-bd6e-4949-8ded-96a98f2fa3c4 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123739 May 26 12:57:12.211368 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 496/993] 10.222.0.41 () {64 vars in 1317 bytes} [Thu May 26 12:57:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:57:12.722277 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [req-0d34924e-f797-4eab-addf-e944d86ab084 req-cf349e74-24cf-4e88-a52b-0e40bdf6c72f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f3fde81-3f47-4590-ad2e-330bd31ed1f7", "name": "network-vif-deleted", "tag": "24bce984-312f-419b-85cf-8dba81242975"}]} {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:57:12.744489 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [req-0d34924e-f797-4eab-addf-e944d86ab084 req-cf349e74-24cf-4e88-a52b-0e40bdf6c72f service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:12.744942 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [req-0d34924e-f797-4eab-addf-e944d86ab084 req-cf349e74-24cf-4e88-a52b-0e40bdf6c72f service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:12.758432 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.compute.server_external_events [req-0d34924e-f797-4eab-addf-e944d86ab084 req-cf349e74-24cf-4e88-a52b-0e40bdf6c72f service nova] Creating event network-vif-deleted:24bce984-312f-419b-85cf-8dba81242975 for instance 7f3fde81-3f47-4590-ad2e-330bd31ed1f7 on hv-cinder-81571 May 26 12:57:12.765222 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [req-0d34924e-f797-4eab-addf-e944d86ab084 req-cf349e74-24cf-4e88-a52b-0e40bdf6c72f service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141840 May 26 12:57:12.766144 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 498/994] 10.222.0.41 () {64 vars in 1317 bytes} [Thu May 26 12:57:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:57:13.097058 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG dbcounter [-] [124823] Writing DB stats nova_cell0:SELECT=8 {{(pid=124823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:57:13.103363 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-602da2d9-493b-44e7-8f7e-bb0f197f44f9 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:57:13.104094 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-602da2d9-493b-44e7-8f7e-bb0f197f44f9 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] [instance: d3e49793-145c-4fea-979c-3875adb1ef35] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:57:13.111513 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-602da2d9-493b-44e7-8f7e-bb0f197f44f9 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:13.116531 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-602da2d9-493b-44e7-8f7e-bb0f197f44f9 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:13.116531 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-602da2d9-493b-44e7-8f7e-bb0f197f44f9 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:13.116531 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-602da2d9-493b-44e7-8f7e-bb0f197f44f9 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:13.165093 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-7c9e4245-7c1c-4114-9c72-13ef6b51da8b tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:57:13.165850 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-7c9e4245-7c1c-4114-9c72-13ef6b51da8b tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] [instance: 7f3fde81-3f47-4590-ad2e-330bd31ed1f7] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:57:13.173199 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-7c9e4245-7c1c-4114-9c72-13ef6b51da8b tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:13.175565 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-7c9e4245-7c1c-4114-9c72-13ef6b51da8b tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:13.176387 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-7c9e4245-7c1c-4114-9c72-13ef6b51da8b tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:13.176844 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-7c9e4245-7c1c-4114-9c72-13ef6b51da8b tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:13.214878 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-7c9e4245-7c1c-4114-9c72-13ef6b51da8b tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:13.215457 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-7c9e4245-7c1c-4114-9c72-13ef6b51da8b tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:13.216026 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.objects.instance [None req-7c9e4245-7c1c-4114-9c72-13ef6b51da8b tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lazy-loading 'fault' on Instance uuid 7f3fde81-3f47-4590-ad2e-330bd31ed1f7 {{(pid=124824) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:57:13.254587 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-602da2d9-493b-44e7-8f7e-bb0f197f44f9 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03ca4f264eb42ddbe92f5cb95d9fc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2ea80ac0374c2c870a494adc6534ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:13.262393 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-602da2d9-493b-44e7-8f7e-bb0f197f44f9 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] 10.222.0.41 "GET /compute/v2.1/servers/d3e49793-145c-4fea-979c-3875adb1ef35" status: 200 len: 1259 microversion: 2.1 time: 0.166181 May 26 12:57:13.263270 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 497/995] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:57:13 2022] GET /compute/v2.1/servers/d3e49793-145c-4fea-979c-3875adb1ef35 => generated 1259 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:57:13.268967 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-7c9e4245-7c1c-4114-9c72-13ef6b51da8b tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa52505a079041efbbf14fb04da7ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe580a28eae4195be1491ac29d373a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:13.277841 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-7c9e4245-7c1c-4114-9c72-13ef6b51da8b tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] 10.222.0.41 "GET /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7" status: 200 len: 1328 microversion: 2.1 time: 0.118078 May 26 12:57:13.278440 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 499/996] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:57:13 2022] GET /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7 => generated 1328 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:57:14.279319 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-173a9d2f-c45c-4e24-8bb3-b4d8311e8a90 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:57:14.279946 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-173a9d2f-c45c-4e24-8bb3-b4d8311e8a90 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] [instance: d3e49793-145c-4fea-979c-3875adb1ef35] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:57:14.286937 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-173a9d2f-c45c-4e24-8bb3-b4d8311e8a90 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:14.287393 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-173a9d2f-c45c-4e24-8bb3-b4d8311e8a90 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:14.288763 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-173a9d2f-c45c-4e24-8bb3-b4d8311e8a90 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:14.289140 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-173a9d2f-c45c-4e24-8bb3-b4d8311e8a90 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:14.298181 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-8eb6c96e-96e2-4102-8583-3f63cb0aa01c tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:57:14.298803 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-8eb6c96e-96e2-4102-8583-3f63cb0aa01c tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] [instance: 7f3fde81-3f47-4590-ad2e-330bd31ed1f7] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:57:14.306220 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-8eb6c96e-96e2-4102-8583-3f63cb0aa01c tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:14.306668 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-8eb6c96e-96e2-4102-8583-3f63cb0aa01c tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:14.307857 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-8eb6c96e-96e2-4102-8583-3f63cb0aa01c tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:14.308892 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-8eb6c96e-96e2-4102-8583-3f63cb0aa01c tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:14.322543 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.wsgi [None req-8eb6c96e-96e2-4102-8583-3f63cb0aa01c tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] HTTP exception thrown: Instance 7f3fde81-3f47-4590-ad2e-330bd31ed1f7 could not be found. May 26 12:57:14.324267 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-8eb6c96e-96e2-4102-8583-3f63cb0aa01c tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Request method failure captured: May 26 12:57:14.324267 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: request: GET /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7 HTTP/1.1 May 26 12:57:14.324267 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Accept: application/json May 26 12:57:14.324267 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Accept-Encoding: identity May 26 12:57:14.324267 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Connection: close May 26 12:57:14.324267 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Content-Length: 0 May 26 12:57:14.324267 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Content-Type: application/json May 26 12:57:14.324267 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Host: 10.222.0.41 May 26 12:57:14.324267 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Openstack-System-Scope: None May 26 12:57:14.324267 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: User-Agent: python-urllib3/1.26.9 May 26 12:57:14.324267 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Auth-Token: gAAAAABij3hkrszXMbOxGaO0XC_ch2m84PydcTKd9ChbDbnHV1NkHyaXMEiNHJHT6esADyyvwy4QNE8tfFZ3dOAN16gUWgyhAuN4rVtWXd5wBHq5BqNnGR1jPm-Js-9omuJGjT4CaP-ieNU8WlTkh0eqwkFYqQ4hEofYMLp5W-UNJRESs7gbWiU May 26 12:57:14.324267 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Domain-Id: None May 26 12:57:14.324267 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Domain-Name: None May 26 12:57:14.324267 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Identity-Status: Confirmed May 26 12:57:14.324267 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Is-Admin-Project: True May 26 12:57:14.324267 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Domain-Id: default May 26 12:57:14.324267 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Domain-Name: Default May 26 12:57:14.324267 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Id: cbe580a28eae4195be1491ac29d373a7 May 26 12:57:14.324267 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Name: tempest-AttachVolumeTestJSON-494224153 May 26 12:57:14.324267 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Role: member,reader May 26 12:57:14.324267 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Roles: member,reader May 26 12:57:14.326254 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/cbe580a28eae4195be1491ac29d373a7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/cbe580a28eae4195be1491ac29d373a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/cbe580a28eae4195be1491ac29d373a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_cbe580a28eae4195be1491ac29d373a7", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 26 12:57:14.326254 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Tenant: tempest-AttachVolumeTestJSON-494224153 May 26 12:57:14.326254 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Tenant-Id: cbe580a28eae4195be1491ac29d373a7 May 26 12:57:14.326254 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Tenant-Name: tempest-AttachVolumeTestJSON-494224153 May 26 12:57:14.326254 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User: tempest-AttachVolumeTestJSON-494224153-project May 26 12:57:14.326254 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Domain-Id: default May 26 12:57:14.326254 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Domain-Name: Default May 26 12:57:14.326254 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Id: aa52505a079041efbbf14fb04da7ac7f May 26 12:57:14.326254 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Name: tempest-AttachVolumeTestJSON-494224153-project May 26 12:57:14.326254 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: method: > May 26 12:57:14.326254 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: exception: Instance 7f3fde81-3f47-4590-ad2e-330bd31ed1f7 could not be found. May 26 12:57:14.326254 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: action_args: {'id': '7f3fde81-3f47-4590-ad2e-330bd31ed1f7'} May 26 12:57:14.327122 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:57:14.327122 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:57:14.327122 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:57:14.327122 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:57:14.327122 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:57:14.327122 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:57:14.327122 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:57:14.327122 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:57:14.327122 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:57:14.327122 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:57:14.327122 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f3fde81-3f47-4590-ad2e-330bd31ed1f7 could not be found. May 26 12:57:14.327122 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:57:14.327122 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:57:14.327122 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:57:14.327122 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:57:14.327122 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:57:14.327122 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:57:14.327122 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:57:14.327122 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:57:14.327122 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:57:14.328625 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:57:14.328625 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 12:57:14.328625 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 12:57:14.328625 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:57:14.328625 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:57:14.328625 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:57:14.328625 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:57:14.328625 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f3fde81-3f47-4590-ad2e-330bd31ed1f7 could not be found. May 26 12:57:14.328625 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:57:14.328625 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:57:14.328625 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:57:14.328625 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:57:14.328625 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:57:14.328625 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:57:14.328625 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:57:14.328625 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:57:14.328625 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f3fde81-3f47-4590-ad2e-330bd31ed1f7 could not be found. May 26 12:57:14.328625 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:57:14.329872 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-8eb6c96e-96e2-4102-8583-3f63cb0aa01c tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Returning 404 to user: Instance 7f3fde81-3f47-4590-ad2e-330bd31ed1f7 could not be found. {{(pid=124824) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:57:14.329872 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-8eb6c96e-96e2-4102-8583-3f63cb0aa01c tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] 10.222.0.41 "GET /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7" status: 404 len: 111 microversion: 2.1 time: 0.033601 May 26 12:57:14.329872 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 500/997] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:57:14 2022] GET /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:57:14.334394 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-5958cf65-8823-468e-ba5a-1a7a40fb20fe tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Calling method '.version_select at 0x7f26a1f3c430>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:57:14.410057 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-5958cf65-8823-468e-ba5a-1a7a40fb20fe tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2136351000" status: 202 len: 0 microversion: 2.1 time: 0.079287 May 26 12:57:14.411103 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 501/998] 10.222.0.41 () {58 vars in 1220 bytes} [Thu May 26 12:57:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2136351000 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 12:57:14.429870 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-173a9d2f-c45c-4e24-8bb3-b4d8311e8a90 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03ca4f264eb42ddbe92f5cb95d9fc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2ea80ac0374c2c870a494adc6534ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:14.437577 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-173a9d2f-c45c-4e24-8bb3-b4d8311e8a90 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] 10.222.0.41 "GET /compute/v2.1/servers/d3e49793-145c-4fea-979c-3875adb1ef35" status: 200 len: 1443 microversion: 2.1 time: 0.162138 May 26 12:57:14.443537 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 498/999] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:57:14 2022] GET /compute/v2.1/servers/d3e49793-145c-4fea-979c-3875adb1ef35 => generated 1443 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:57:14.457620 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-7e5515f1-7a53-445e-b5f0-6639f3cc22a0 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:57:14.458528 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-7e5515f1-7a53-445e-b5f0-6639f3cc22a0 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] [instance: d3e49793-145c-4fea-979c-3875adb1ef35] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:57:14.465621 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-7e5515f1-7a53-445e-b5f0-6639f3cc22a0 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:14.466102 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-7e5515f1-7a53-445e-b5f0-6639f3cc22a0 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:14.466869 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-7e5515f1-7a53-445e-b5f0-6639f3cc22a0 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:14.467301 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-7e5515f1-7a53-445e-b5f0-6639f3cc22a0 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:14.623277 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-7e5515f1-7a53-445e-b5f0-6639f3cc22a0 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03ca4f264eb42ddbe92f5cb95d9fc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2ea80ac0374c2c870a494adc6534ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:14.631001 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-7e5515f1-7a53-445e-b5f0-6639f3cc22a0 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] 10.222.0.41 "GET /compute/v2.1/servers/d3e49793-145c-4fea-979c-3875adb1ef35" status: 200 len: 1443 microversion: 2.1 time: 0.177257 May 26 12:57:14.680676 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 502/1000] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:57:14 2022] GET /compute/v2.1/servers/d3e49793-145c-4fea-979c-3875adb1ef35 => generated 1443 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:57:15.739063 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-059a28cd-d659-45f1-a42c-ec9d18fbcc64 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Action: 'create', calling method: .version_select at 0x7f26a1d745e0>, body: {"keypair": {"name": "tempest-keypair-1778190042", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLRZ5ye9oAhLAOE1lDBBr5ykYFBqVa4LDbJzee7xob8heWKeND4DqxVJilOGs1touM/KSk52FdQRzS0rxdn3l0qkyJqtIu/ynBUNTISxgfuRycFiJ1u3VAaFK58C16UVkg=="}} {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:57:15.755087 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.quota [None req-059a28cd-d659-45f1-a42c-ec9d18fbcc64 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Getting quotas for project cbe580a28eae4195be1491ac29d373a7. Resources: {'key_pairs'} {{(pid=124823) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:57:15.759906 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.quota [None req-059a28cd-d659-45f1-a42c-ec9d18fbcc64 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Getting quotas for user aa52505a079041efbbf14fb04da7ac7f and project cbe580a28eae4195be1491ac29d373a7. Resources: {'key_pairs'} {{(pid=124823) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:57:15.904417 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-059a28cd-d659-45f1-a42c-ec9d18fbcc64 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.169162 May 26 12:57:15.905144 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 499/1001] 10.222.0.41 () {60 vars in 1158 bytes} [Thu May 26 12:57:15 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:57:17.359076 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [req-47b86e6b-4ece-4173-aa12-2afda42e781a req-4e381d37-86f0-4347-a62c-df87287198ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3e49793-145c-4fea-979c-3875adb1ef35", "tag": "e52542b8-e1ca-485c-bbda-287934dde033"}]} {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:57:17.368405 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [req-47b86e6b-4ece-4173-aa12-2afda42e781a req-4e381d37-86f0-4347-a62c-df87287198ca service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:17.368865 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [req-47b86e6b-4ece-4173-aa12-2afda42e781a req-4e381d37-86f0-4347-a62c-df87287198ca service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:17.383226 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.compute.server_external_events [req-47b86e6b-4ece-4173-aa12-2afda42e781a req-4e381d37-86f0-4347-a62c-df87287198ca service nova] Creating event network-changed:e52542b8-e1ca-485c-bbda-287934dde033 for instance d3e49793-145c-4fea-979c-3875adb1ef35 on hv-cinder-81571 May 26 12:57:17.388894 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [req-47b86e6b-4ece-4173-aa12-2afda42e781a req-4e381d37-86f0-4347-a62c-df87287198ca service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033509 May 26 12:57:17.389974 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 503/1002] 10.222.0.41 () {64 vars in 1317 bytes} [Thu May 26 12:57:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:57:18.598521 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-aa7b5f80-5259-4008-82cb-be1bb4d3186c tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1952938948", "imageRef": "6df25342-b071-489b-a7c1-3089fa19af6d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "eb415de3-e6dc-4384-aaf7-8dbb57dc125b"}], "security_groups": [{"name": "tempest-securitygroup--650478191"}], "key_name": "tempest-keypair-1778190042", "user_data": "}} {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:57:18.707200 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.network.neutron [None req-aa7b5f80-5259-4008-82cb-be1bb4d3186c tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] validate_networks() for [('eb415de3-e6dc-4384-aaf7-8dbb57dc125b', None, None, None, None, None)] {{(pid=124823) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 12:57:19.081766 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.virt.hardware [None req-aa7b5f80-5259-4008-82cb-be1bb4d3186c tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Flavor limits 0:0:0 {{(pid=124823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 12:57:19.081766 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.virt.hardware [None req-aa7b5f80-5259-4008-82cb-be1bb4d3186c tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Image limits 0:0:0 {{(pid=124823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 12:57:19.081766 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.virt.hardware [None req-aa7b5f80-5259-4008-82cb-be1bb4d3186c tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Flavor pref 0:0:0 {{(pid=124823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 12:57:19.081766 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.virt.hardware [None req-aa7b5f80-5259-4008-82cb-be1bb4d3186c tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Image pref 0:0:0 {{(pid=124823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 12:57:19.081766 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.virt.hardware [None req-aa7b5f80-5259-4008-82cb-be1bb4d3186c tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 12:57:19.090932 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-aa7b5f80-5259-4008-82cb-be1bb4d3186c tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:19.091379 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-aa7b5f80-5259-4008-82cb-be1bb4d3186c tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:19.092175 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-aa7b5f80-5259-4008-82cb-be1bb4d3186c tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:19.092877 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-aa7b5f80-5259-4008-82cb-be1bb4d3186c tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:19.112196 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.quota [None req-aa7b5f80-5259-4008-82cb-be1bb4d3186c tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Getting quotas for project cbe580a28eae4195be1491ac29d373a7. Resources: {'instances', 'ram', 'cores'} {{(pid=124823) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:57:19.121405 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.quota [None req-aa7b5f80-5259-4008-82cb-be1bb4d3186c tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Getting quotas for user aa52505a079041efbbf14fb04da7ac7f and project cbe580a28eae4195be1491ac29d373a7. Resources: {'instances', 'ram', 'cores'} {{(pid=124823) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:57:19.128254 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-aa7b5f80-5259-4008-82cb-be1bb4d3186c tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Going to run 1 instances... {{(pid=124823) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 12:57:19.130569 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-aa7b5f80-5259-4008-82cb-be1bb4d3186c tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] [instance: 32d87977-fb85-4de5-96a8-e3b1cf8be517] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6df25342-b071-489b-a7c1-3089fa19af6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124823) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 12:57:19.270245 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-aa7b5f80-5259-4008-82cb-be1bb4d3186c tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.676437 May 26 12:57:19.271101 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 500/1003] 10.222.0.41 () {60 vars in 1146 bytes} [Thu May 26 12:57:18 2022] POST /compute/v2.1/servers => generated 401 bytes in 678 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 26 12:57:19.281781 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-ac0b9ee0-76c9-4864-b8e6-a61856ab3f8e tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:57:19.282477 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-ac0b9ee0-76c9-4864-b8e6-a61856ab3f8e tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] [instance: 32d87977-fb85-4de5-96a8-e3b1cf8be517] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:57:19.338837 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-ac0b9ee0-76c9-4864-b8e6-a61856ab3f8e tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa52505a079041efbbf14fb04da7ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe580a28eae4195be1491ac29d373a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:19.346001 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-ac0b9ee0-76c9-4864-b8e6-a61856ab3f8e tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] 10.222.0.41 "GET /compute/v2.1/servers/32d87977-fb85-4de5-96a8-e3b1cf8be517" status: 200 len: 1238 microversion: 2.1 time: 0.068544 May 26 12:57:19.346577 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 504/1004] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:57:19 2022] GET /compute/v2.1/servers/32d87977-fb85-4de5-96a8-e3b1cf8be517 => generated 1238 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:57:20.367697 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-595d9bea-1721-4581-b298-3a9d505e4a5b tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:57:20.368810 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-595d9bea-1721-4581-b298-3a9d505e4a5b tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] [instance: 32d87977-fb85-4de5-96a8-e3b1cf8be517] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:57:20.380358 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-595d9bea-1721-4581-b298-3a9d505e4a5b tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:20.380611 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-595d9bea-1721-4581-b298-3a9d505e4a5b tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:20.382397 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-595d9bea-1721-4581-b298-3a9d505e4a5b tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:20.383180 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-595d9bea-1721-4581-b298-3a9d505e4a5b tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:20.450085 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-595d9bea-1721-4581-b298-3a9d505e4a5b tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa52505a079041efbbf14fb04da7ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe580a28eae4195be1491ac29d373a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:20.457919 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-595d9bea-1721-4581-b298-3a9d505e4a5b tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] 10.222.0.41 "GET /compute/v2.1/servers/32d87977-fb85-4de5-96a8-e3b1cf8be517" status: 200 len: 1242 microversion: 2.1 time: 0.098351 May 26 12:57:20.458583 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 501/1005] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:57:20 2022] GET /compute/v2.1/servers/32d87977-fb85-4de5-96a8-e3b1cf8be517 => generated 1242 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:57:21.476599 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-a53765dc-097b-455f-99c6-dc489eeba5ef tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:57:21.477201 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-a53765dc-097b-455f-99c6-dc489eeba5ef tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] [instance: 32d87977-fb85-4de5-96a8-e3b1cf8be517] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:57:21.483961 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-a53765dc-097b-455f-99c6-dc489eeba5ef tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:21.484411 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-a53765dc-097b-455f-99c6-dc489eeba5ef tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:21.485257 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-a53765dc-097b-455f-99c6-dc489eeba5ef tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:21.485597 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-a53765dc-097b-455f-99c6-dc489eeba5ef tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:21.549131 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-a53765dc-097b-455f-99c6-dc489eeba5ef tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa52505a079041efbbf14fb04da7ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe580a28eae4195be1491ac29d373a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:21.557064 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-a53765dc-097b-455f-99c6-dc489eeba5ef tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] 10.222.0.41 "GET /compute/v2.1/servers/32d87977-fb85-4de5-96a8-e3b1cf8be517" status: 200 len: 1308 microversion: 2.1 time: 0.084935 May 26 12:57:21.557623 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 505/1006] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:57:21 2022] GET /compute/v2.1/servers/32d87977-fb85-4de5-96a8-e3b1cf8be517 => generated 1308 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:57:22.574168 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-2ff3a98d-9eea-4b77-bd7a-abdf136ffe3d tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:57:22.574764 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-2ff3a98d-9eea-4b77-bd7a-abdf136ffe3d tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] [instance: 32d87977-fb85-4de5-96a8-e3b1cf8be517] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:57:22.581437 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-2ff3a98d-9eea-4b77-bd7a-abdf136ffe3d tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:22.581919 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-2ff3a98d-9eea-4b77-bd7a-abdf136ffe3d tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:22.582851 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-2ff3a98d-9eea-4b77-bd7a-abdf136ffe3d tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:22.583285 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-2ff3a98d-9eea-4b77-bd7a-abdf136ffe3d tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:22.897292 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-2ff3a98d-9eea-4b77-bd7a-abdf136ffe3d tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa52505a079041efbbf14fb04da7ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe580a28eae4195be1491ac29d373a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:22.905505 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-2ff3a98d-9eea-4b77-bd7a-abdf136ffe3d tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] 10.222.0.41 "GET /compute/v2.1/servers/32d87977-fb85-4de5-96a8-e3b1cf8be517" status: 200 len: 1363 microversion: 2.1 time: 0.335346 May 26 12:57:22.906340 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 502/1007] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:57:22 2022] GET /compute/v2.1/servers/32d87977-fb85-4de5-96a8-e3b1cf8be517 => generated 1363 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:57:23.101035 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [req-9af80e2f-4dac-44ea-bfb4-9fe5c4c7d469 req-e9eff4c3-5180-456a-8779-23b2ac43fa57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32d87977-fb85-4de5-96a8-e3b1cf8be517", "tag": "e2b7f26f-96f3-4216-ade5-57d6f67846db"}]} {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:57:23.116658 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [req-9af80e2f-4dac-44ea-bfb4-9fe5c4c7d469 req-e9eff4c3-5180-456a-8779-23b2ac43fa57 service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:23.117168 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [req-9af80e2f-4dac-44ea-bfb4-9fe5c4c7d469 req-e9eff4c3-5180-456a-8779-23b2ac43fa57 service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:23.129158 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.compute.server_external_events [req-9af80e2f-4dac-44ea-bfb4-9fe5c4c7d469 req-e9eff4c3-5180-456a-8779-23b2ac43fa57 service nova] Creating event network-changed:e2b7f26f-96f3-4216-ade5-57d6f67846db for instance 32d87977-fb85-4de5-96a8-e3b1cf8be517 on hv-cinder-81571 May 26 12:57:23.134457 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [req-9af80e2f-4dac-44ea-bfb4-9fe5c4c7d469 req-e9eff4c3-5180-456a-8779-23b2ac43fa57 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037894 May 26 12:57:23.135149 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 506/1008] 10.222.0.41 () {64 vars in 1317 bytes} [Thu May 26 12:57:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:57:23.923658 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-9168b1ae-d9c3-4d89-a4e8-eb48f4b95080 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:57:23.924276 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-9168b1ae-d9c3-4d89-a4e8-eb48f4b95080 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] [instance: 32d87977-fb85-4de5-96a8-e3b1cf8be517] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:57:23.931525 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-9168b1ae-d9c3-4d89-a4e8-eb48f4b95080 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:23.931974 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-9168b1ae-d9c3-4d89-a4e8-eb48f4b95080 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:23.932739 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-9168b1ae-d9c3-4d89-a4e8-eb48f4b95080 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:23.933179 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-9168b1ae-d9c3-4d89-a4e8-eb48f4b95080 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:24.062410 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-9168b1ae-d9c3-4d89-a4e8-eb48f4b95080 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa52505a079041efbbf14fb04da7ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe580a28eae4195be1491ac29d373a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:24.069852 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-9168b1ae-d9c3-4d89-a4e8-eb48f4b95080 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] 10.222.0.41 "GET /compute/v2.1/servers/32d87977-fb85-4de5-96a8-e3b1cf8be517" status: 200 len: 1363 microversion: 2.1 time: 0.150124 May 26 12:57:24.070448 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 503/1009] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:57:23 2022] GET /compute/v2.1/servers/32d87977-fb85-4de5-96a8-e3b1cf8be517 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:57:25.087742 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-d6dd21ea-bf34-4d28-8316-571d3266b8ff tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:57:25.088433 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-d6dd21ea-bf34-4d28-8316-571d3266b8ff tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] [instance: 32d87977-fb85-4de5-96a8-e3b1cf8be517] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:57:25.094949 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-d6dd21ea-bf34-4d28-8316-571d3266b8ff tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:25.095394 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-d6dd21ea-bf34-4d28-8316-571d3266b8ff tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:25.096143 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-d6dd21ea-bf34-4d28-8316-571d3266b8ff tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:25.096569 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-d6dd21ea-bf34-4d28-8316-571d3266b8ff tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:25.228499 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-d6dd21ea-bf34-4d28-8316-571d3266b8ff tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa52505a079041efbbf14fb04da7ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe580a28eae4195be1491ac29d373a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:25.235848 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-d6dd21ea-bf34-4d28-8316-571d3266b8ff tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] 10.222.0.41 "GET /compute/v2.1/servers/32d87977-fb85-4de5-96a8-e3b1cf8be517" status: 200 len: 1363 microversion: 2.1 time: 0.152868 May 26 12:57:25.236421 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 507/1010] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:57:25 2022] GET /compute/v2.1/servers/32d87977-fb85-4de5-96a8-e3b1cf8be517 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:57:26.252846 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-cd69d6de-6784-467e-9dee-20782ce03c53 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:57:26.253604 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-cd69d6de-6784-467e-9dee-20782ce03c53 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] [instance: 32d87977-fb85-4de5-96a8-e3b1cf8be517] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:57:26.262002 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-cd69d6de-6784-467e-9dee-20782ce03c53 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:26.262456 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-cd69d6de-6784-467e-9dee-20782ce03c53 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:26.263254 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-cd69d6de-6784-467e-9dee-20782ce03c53 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:26.263649 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-cd69d6de-6784-467e-9dee-20782ce03c53 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:26.395982 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-cd69d6de-6784-467e-9dee-20782ce03c53 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa52505a079041efbbf14fb04da7ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe580a28eae4195be1491ac29d373a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:26.404108 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-cd69d6de-6784-467e-9dee-20782ce03c53 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] 10.222.0.41 "GET /compute/v2.1/servers/32d87977-fb85-4de5-96a8-e3b1cf8be517" status: 200 len: 1363 microversion: 2.1 time: 0.155501 May 26 12:57:26.404705 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 504/1011] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:57:26 2022] GET /compute/v2.1/servers/32d87977-fb85-4de5-96a8-e3b1cf8be517 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:57:27.421216 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-f86f7629-ddd0-4a43-ad8e-38be4111b931 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:57:27.421891 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-f86f7629-ddd0-4a43-ad8e-38be4111b931 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] [instance: 32d87977-fb85-4de5-96a8-e3b1cf8be517] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:57:27.429059 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-f86f7629-ddd0-4a43-ad8e-38be4111b931 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:27.429512 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-f86f7629-ddd0-4a43-ad8e-38be4111b931 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:27.430307 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-f86f7629-ddd0-4a43-ad8e-38be4111b931 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:27.430748 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-f86f7629-ddd0-4a43-ad8e-38be4111b931 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:27.557682 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-f86f7629-ddd0-4a43-ad8e-38be4111b931 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa52505a079041efbbf14fb04da7ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe580a28eae4195be1491ac29d373a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:27.565216 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-f86f7629-ddd0-4a43-ad8e-38be4111b931 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] 10.222.0.41 "GET /compute/v2.1/servers/32d87977-fb85-4de5-96a8-e3b1cf8be517" status: 200 len: 1363 microversion: 2.1 time: 0.147918 May 26 12:57:27.565805 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 508/1012] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:57:27 2022] GET /compute/v2.1/servers/32d87977-fb85-4de5-96a8-e3b1cf8be517 => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:57:28.217938 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [req-5ce89ebd-0dd0-4bb6-b17a-449d2aa5f98a req-5d60df5b-0987-4490-9bad-c811182ee453 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32d87977-fb85-4de5-96a8-e3b1cf8be517", "name": "network-vif-plugged", "status": "completed", "tag": "e2b7f26f-96f3-4216-ade5-57d6f67846db"}]} {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:57:28.227255 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [req-5ce89ebd-0dd0-4bb6-b17a-449d2aa5f98a req-5d60df5b-0987-4490-9bad-c811182ee453 service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:28.227705 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [req-5ce89ebd-0dd0-4bb6-b17a-449d2aa5f98a req-5d60df5b-0987-4490-9bad-c811182ee453 service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:28.238574 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.compute.server_external_events [req-5ce89ebd-0dd0-4bb6-b17a-449d2aa5f98a req-5d60df5b-0987-4490-9bad-c811182ee453 service nova] Creating event network-vif-plugged:e2b7f26f-96f3-4216-ade5-57d6f67846db for instance 32d87977-fb85-4de5-96a8-e3b1cf8be517 on hv-cinder-81571 May 26 12:57:28.243975 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [req-5ce89ebd-0dd0-4bb6-b17a-449d2aa5f98a req-5d60df5b-0987-4490-9bad-c811182ee453 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030200 May 26 12:57:28.244567 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 505/1013] 10.222.0.41 () {64 vars in 1317 bytes} [Thu May 26 12:57:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:57:28.581486 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-37f8a875-c0ad-4d4d-bedf-254690657778 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:57:28.582128 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-37f8a875-c0ad-4d4d-bedf-254690657778 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] [instance: 32d87977-fb85-4de5-96a8-e3b1cf8be517] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:57:28.588811 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-37f8a875-c0ad-4d4d-bedf-254690657778 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:28.589258 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-37f8a875-c0ad-4d4d-bedf-254690657778 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:28.590204 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-37f8a875-c0ad-4d4d-bedf-254690657778 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:28.590649 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-37f8a875-c0ad-4d4d-bedf-254690657778 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:28.723344 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-37f8a875-c0ad-4d4d-bedf-254690657778 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa52505a079041efbbf14fb04da7ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe580a28eae4195be1491ac29d373a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:28.731409 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-37f8a875-c0ad-4d4d-bedf-254690657778 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] 10.222.0.41 "GET /compute/v2.1/servers/32d87977-fb85-4de5-96a8-e3b1cf8be517" status: 200 len: 1363 microversion: 2.1 time: 0.153852 May 26 12:57:28.731977 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 509/1014] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:57:28 2022] GET /compute/v2.1/servers/32d87977-fb85-4de5-96a8-e3b1cf8be517 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:57:29.746059 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG dbcounter [-] [124823] Writing DB stats nova_cell0:SELECT=2 {{(pid=124823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:57:29.746773 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG dbcounter [-] [124823] Writing DB stats nova_cell0:SELECT=10 {{(pid=124823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:57:29.751257 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-347d4b6f-4f42-434a-a553-a27729aa18c6 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:57:29.751963 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-347d4b6f-4f42-434a-a553-a27729aa18c6 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] [instance: 32d87977-fb85-4de5-96a8-e3b1cf8be517] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:57:29.758456 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-347d4b6f-4f42-434a-a553-a27729aa18c6 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:29.758907 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-347d4b6f-4f42-434a-a553-a27729aa18c6 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:29.764735 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-347d4b6f-4f42-434a-a553-a27729aa18c6 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:29.764735 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-347d4b6f-4f42-434a-a553-a27729aa18c6 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:29.894611 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-347d4b6f-4f42-434a-a553-a27729aa18c6 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa52505a079041efbbf14fb04da7ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe580a28eae4195be1491ac29d373a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:29.902750 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-347d4b6f-4f42-434a-a553-a27729aa18c6 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] 10.222.0.41 "GET /compute/v2.1/servers/32d87977-fb85-4de5-96a8-e3b1cf8be517" status: 200 len: 1363 microversion: 2.1 time: 0.157757 May 26 12:57:29.903315 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 506/1015] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:57:29 2022] GET /compute/v2.1/servers/32d87977-fb85-4de5-96a8-e3b1cf8be517 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:57:30.919500 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-52bcb0da-8c23-4b35-a103-12ab33480735 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:57:30.920172 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-52bcb0da-8c23-4b35-a103-12ab33480735 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] [instance: 32d87977-fb85-4de5-96a8-e3b1cf8be517] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:57:30.922169 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG dbcounter [-] [124824] Writing DB stats nova_cell0:SELECT=2 {{(pid=124824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:57:30.927773 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-52bcb0da-8c23-4b35-a103-12ab33480735 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:30.934457 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-52bcb0da-8c23-4b35-a103-12ab33480735 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:30.934457 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-52bcb0da-8c23-4b35-a103-12ab33480735 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:30.934457 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-52bcb0da-8c23-4b35-a103-12ab33480735 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:30.934457 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG dbcounter [-] [124824] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:57:31.061753 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-52bcb0da-8c23-4b35-a103-12ab33480735 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa52505a079041efbbf14fb04da7ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe580a28eae4195be1491ac29d373a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:57:31.069836 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-52bcb0da-8c23-4b35-a103-12ab33480735 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] 10.222.0.41 "GET /compute/v2.1/servers/32d87977-fb85-4de5-96a8-e3b1cf8be517" status: 200 len: 1548 microversion: 2.1 time: 0.154220 May 26 12:57:31.070524 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 510/1016] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:57:30 2022] GET /compute/v2.1/servers/32d87977-fb85-4de5-96a8-e3b1cf8be517 => generated 1548 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:57:31.087008 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-249d2235-432b-462a-b29e-45228e1db34c tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:57:31.093300 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-249d2235-432b-462a-b29e-45228e1db34c tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] [instance: 32d87977-fb85-4de5-96a8-e3b1cf8be517] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:57:31.093300 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG dbcounter [-] [124823] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=7 {{(pid=124823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:57:31.094715 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-249d2235-432b-462a-b29e-45228e1db34c tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:31.095172 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-249d2235-432b-462a-b29e-45228e1db34c tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:31.095945 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-249d2235-432b-462a-b29e-45228e1db34c tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:31.096388 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-249d2235-432b-462a-b29e-45228e1db34c tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:31.098795 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG dbcounter [-] [124823] Writing DB stats nova_cell1:SELECT=89 {{(pid=124823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:57:31.174250 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-249d2235-432b-462a-b29e-45228e1db34c tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] 10.222.0.41 "GET /compute/v2.1/servers/32d87977-fb85-4de5-96a8-e3b1cf8be517/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091690 May 26 12:57:31.174858 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 507/1017] 10.222.0.41 () {58 vars in 1274 bytes} [Thu May 26 12:57:31 2022] GET /compute/v2.1/servers/32d87977-fb85-4de5-96a8-e3b1cf8be517/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:57:32.446296 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [req-45d95e26-6dc6-4b63-ae0b-f0dd355f9f96 req-29421ad2-1d58-4c4f-b365-e20e075b62a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32d87977-fb85-4de5-96a8-e3b1cf8be517", "tag": "e2b7f26f-96f3-4216-ade5-57d6f67846db"}]} {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:57:32.449755 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG dbcounter [-] [124824] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:57:32.454981 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [req-45d95e26-6dc6-4b63-ae0b-f0dd355f9f96 req-29421ad2-1d58-4c4f-b365-e20e075b62a5 service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:57:32.455425 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [req-45d95e26-6dc6-4b63-ae0b-f0dd355f9f96 req-29421ad2-1d58-4c4f-b365-e20e075b62a5 service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:57:32.469394 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.compute.server_external_events [req-45d95e26-6dc6-4b63-ae0b-f0dd355f9f96 req-29421ad2-1d58-4c4f-b365-e20e075b62a5 service nova] Creating event network-changed:e2b7f26f-96f3-4216-ade5-57d6f67846db for instance 32d87977-fb85-4de5-96a8-e3b1cf8be517 on hv-cinder-81571 May 26 12:57:32.474597 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [req-45d95e26-6dc6-4b63-ae0b-f0dd355f9f96 req-29421ad2-1d58-4c4f-b365-e20e075b62a5 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087712 May 26 12:57:32.475425 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 511/1018] 10.222.0.41 () {64 vars in 1317 bytes} [Thu May 26 12:57:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:58:08.549942 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-1b1eec2a-5d0b-4785-b586-a598ae1270de tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:58:08.550547 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-1b1eec2a-5d0b-4785-b586-a598ae1270de tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] [instance: 32d87977-fb85-4de5-96a8-e3b1cf8be517] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:58:08.557468 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-1b1eec2a-5d0b-4785-b586-a598ae1270de tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:58:08.557959 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-1b1eec2a-5d0b-4785-b586-a598ae1270de tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:58:08.558728 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-1b1eec2a-5d0b-4785-b586-a598ae1270de tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:58:08.559167 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-1b1eec2a-5d0b-4785-b586-a598ae1270de tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:58:08.581985 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-1b1eec2a-5d0b-4785-b586-a598ae1270de tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] 10.222.0.41 "GET /compute/v2.1/servers/32d87977-fb85-4de5-96a8-e3b1cf8be517/ips" status: 200 len: 145 microversion: 2.1 time: 0.037379 May 26 12:58:08.582612 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 508/1019] 10.222.0.41 () {58 vars in 1247 bytes} [Thu May 26 12:58:08 2022] GET /compute/v2.1/servers/32d87977-fb85-4de5-96a8-e3b1cf8be517/ips => generated 145 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:58:10.153522 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG dbcounter [-] [124824] Writing DB stats nova_cell1:SELECT=6 {{(pid=124824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:58:10.158156 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-971c49a0-9690-47d5-8334-a46b69054052 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d156312c-a2f3-4c1d-9d0f-5146db7cb05a"}} {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:58:10.159288 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-971c49a0-9690-47d5-8334-a46b69054052 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] [instance: 32d87977-fb85-4de5-96a8-e3b1cf8be517] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:58:10.166218 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-971c49a0-9690-47d5-8334-a46b69054052 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:58:10.166660 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-971c49a0-9690-47d5-8334-a46b69054052 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:58:10.167415 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-971c49a0-9690-47d5-8334-a46b69054052 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:58:10.167845 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-971c49a0-9690-47d5-8334-a46b69054052 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:58:10.968699 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-971c49a0-9690-47d5-8334-a46b69054052 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] 10.222.0.41 "POST /compute/v2.1/servers/32d87977-fb85-4de5-96a8-e3b1cf8be517/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.816519 May 26 12:58:10.969332 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 512/1020] 10.222.0.41 () {60 vars in 1322 bytes} [Thu May 26 12:58:10 2022] POST /compute/v2.1/servers/32d87977-fb85-4de5-96a8-e3b1cf8be517/os-volume_attachments => generated 194 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:58:18.465092 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-e0de9cd5-07ef-4221-95d2-07c789db0aa4 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:58:18.467520 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-e0de9cd5-07ef-4221-95d2-07c789db0aa4 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] [instance: 32d87977-fb85-4de5-96a8-e3b1cf8be517] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:58:18.473141 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-e0de9cd5-07ef-4221-95d2-07c789db0aa4 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:58:18.473606 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-e0de9cd5-07ef-4221-95d2-07c789db0aa4 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:58:18.474571 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-e0de9cd5-07ef-4221-95d2-07c789db0aa4 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:58:18.475013 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-e0de9cd5-07ef-4221-95d2-07c789db0aa4 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:58:18.504676 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-e0de9cd5-07ef-4221-95d2-07c789db0aa4 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] 10.222.0.41 "GET /compute/v2.1/servers/32d87977-fb85-4de5-96a8-e3b1cf8be517/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043984 May 26 12:58:18.505165 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 509/1021] 10.222.0.41 () {58 vars in 1301 bytes} [Thu May 26 12:58:18 2022] GET /compute/v2.1/servers/32d87977-fb85-4de5-96a8-e3b1cf8be517/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:58:18.516166 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-b5f58368-b3f4-4827-966f-4723cfa90555 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:58:18.516754 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-b5f58368-b3f4-4827-966f-4723cfa90555 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] [instance: 32d87977-fb85-4de5-96a8-e3b1cf8be517] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:58:18.523285 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-b5f58368-b3f4-4827-966f-4723cfa90555 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:58:18.523735 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-b5f58368-b3f4-4827-966f-4723cfa90555 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:58:18.525002 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-b5f58368-b3f4-4827-966f-4723cfa90555 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:58:18.525440 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-b5f58368-b3f4-4827-966f-4723cfa90555 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:58:18.554628 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-b5f58368-b3f4-4827-966f-4723cfa90555 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] 10.222.0.41 "GET /compute/v2.1/servers/32d87977-fb85-4de5-96a8-e3b1cf8be517/os-volume_attachments/d156312c-a2f3-4c1d-9d0f-5146db7cb05a" status: 200 len: 194 microversion: 2.1 time: 0.043250 May 26 12:58:18.555252 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 513/1022] 10.222.0.41 () {58 vars in 1412 bytes} [Thu May 26 12:58:18 2022] GET /compute/v2.1/servers/32d87977-fb85-4de5-96a8-e3b1cf8be517/os-volume_attachments/d156312c-a2f3-4c1d-9d0f-5146db7cb05a => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:58:20.191002 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-9d57ac6d-e326-4f30-b161-96f2dadb04c6 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b77837a8-db8a-462d-a345-2295b71582ca"}} {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:58:20.192072 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-9d57ac6d-e326-4f30-b161-96f2dadb04c6 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] [instance: 32d87977-fb85-4de5-96a8-e3b1cf8be517] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:58:20.198700 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-9d57ac6d-e326-4f30-b161-96f2dadb04c6 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:58:20.199159 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-9d57ac6d-e326-4f30-b161-96f2dadb04c6 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:58:20.199929 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-9d57ac6d-e326-4f30-b161-96f2dadb04c6 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:58:20.200366 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-9d57ac6d-e326-4f30-b161-96f2dadb04c6 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:58:20.415385 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-43574db5-cf42-4684-9987-45717cfc6b41 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:58:20.415992 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-43574db5-cf42-4684-9987-45717cfc6b41 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] [instance: 6e0af4d0-3c35-4826-868b-6a60b7c7cb7b] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:58:20.422952 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-43574db5-cf42-4684-9987-45717cfc6b41 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:58:20.428668 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-43574db5-cf42-4684-9987-45717cfc6b41 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:58:20.428668 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-43574db5-cf42-4684-9987-45717cfc6b41 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:58:20.428668 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-43574db5-cf42-4684-9987-45717cfc6b41 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:58:20.450879 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-43574db5-cf42-4684-9987-45717cfc6b41 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] [instance: 6e0af4d0-3c35-4826-868b-6a60b7c7cb7b] Going to try to terminate instance {{(pid=124824) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 12:58:20.780959 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-43574db5-cf42-4684-9987-45717cfc6b41 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] 10.222.0.41 "DELETE /compute/v2.1/servers/6e0af4d0-3c35-4826-868b-6a60b7c7cb7b" status: 204 len: 0 microversion: 2.1 time: 0.370203 May 26 12:58:20.782238 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 514/1023] 10.222.0.41 () {58 vars in 1238 bytes} [Thu May 26 12:58:20 2022] DELETE /compute/v2.1/servers/6e0af4d0-3c35-4826-868b-6a60b7c7cb7b => generated 0 bytes in 373 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 26 12:58:20.793441 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [req-7582df38-2431-462b-b255-917c15bdfa31 req-caeb019c-4d75-4058-9b4c-19cd6827b891 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e0af4d0-3c35-4826-868b-6a60b7c7cb7b", "tag": "2b014596-4175-45bc-ae4e-056fcfa9a229"}]} {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:58:20.807205 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [req-7582df38-2431-462b-b255-917c15bdfa31 req-caeb019c-4d75-4058-9b4c-19cd6827b891 service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:58:20.807657 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [req-7582df38-2431-462b-b255-917c15bdfa31 req-caeb019c-4d75-4058-9b4c-19cd6827b891 service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:58:20.819435 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.compute.server_external_events [req-7582df38-2431-462b-b255-917c15bdfa31 req-caeb019c-4d75-4058-9b4c-19cd6827b891 service nova] Creating event network-changed:2b014596-4175-45bc-ae4e-056fcfa9a229 for instance 6e0af4d0-3c35-4826-868b-6a60b7c7cb7b on hv-cinder-81571 May 26 12:58:20.824311 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [req-7582df38-2431-462b-b255-917c15bdfa31 req-caeb019c-4d75-4058-9b4c-19cd6827b891 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039978 May 26 12:58:20.824914 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 515/1024] 10.222.0.41 () {64 vars in 1317 bytes} [Thu May 26 12:58:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:58:20.832158 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-d8d30a4a-b2ef-4ee6-8032-8e999b82b9dc tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:58:20.832158 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-d8d30a4a-b2ef-4ee6-8032-8e999b82b9dc tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] [instance: 6e0af4d0-3c35-4826-868b-6a60b7c7cb7b] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:58:20.838521 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-d8d30a4a-b2ef-4ee6-8032-8e999b82b9dc tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:58:20.838985 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-d8d30a4a-b2ef-4ee6-8032-8e999b82b9dc tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:58:20.839752 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-d8d30a4a-b2ef-4ee6-8032-8e999b82b9dc tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:58:20.840311 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-d8d30a4a-b2ef-4ee6-8032-8e999b82b9dc tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:58:20.950319 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-9d57ac6d-e326-4f30-b161-96f2dadb04c6 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] 10.222.0.41 "POST /compute/v2.1/servers/32d87977-fb85-4de5-96a8-e3b1cf8be517/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.762960 May 26 12:58:20.955432 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 510/1025] 10.222.0.41 () {60 vars in 1322 bytes} [Thu May 26 12:58:20 2022] POST /compute/v2.1/servers/32d87977-fb85-4de5-96a8-e3b1cf8be517/os-volume_attachments => generated 194 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:58:20.997048 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-d8d30a4a-b2ef-4ee6-8032-8e999b82b9dc tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47d51863b0448b880dc03b01dec6dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23568023763549669484e71430e34389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:58:21.005005 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-d8d30a4a-b2ef-4ee6-8032-8e999b82b9dc tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] 10.222.0.41 "GET /compute/v2.1/servers/6e0af4d0-3c35-4826-868b-6a60b7c7cb7b" status: 200 len: 1577 microversion: 2.1 time: 0.178097 May 26 12:58:21.005948 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 516/1026] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:58:20 2022] GET /compute/v2.1/servers/6e0af4d0-3c35-4826-868b-6a60b7c7cb7b => generated 1577 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:58:22.024772 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-dd804b52-e71f-46a4-9d05-62d536b2049c tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:58:22.025467 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-dd804b52-e71f-46a4-9d05-62d536b2049c tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] [instance: 6e0af4d0-3c35-4826-868b-6a60b7c7cb7b] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:58:22.032071 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-dd804b52-e71f-46a4-9d05-62d536b2049c tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:58:22.032572 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-dd804b52-e71f-46a4-9d05-62d536b2049c tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:58:22.033296 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-dd804b52-e71f-46a4-9d05-62d536b2049c tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:58:22.033766 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-dd804b52-e71f-46a4-9d05-62d536b2049c tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:58:22.230689 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-dd804b52-e71f-46a4-9d05-62d536b2049c tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47d51863b0448b880dc03b01dec6dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23568023763549669484e71430e34389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:58:22.238275 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-dd804b52-e71f-46a4-9d05-62d536b2049c tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] 10.222.0.41 "GET /compute/v2.1/servers/6e0af4d0-3c35-4826-868b-6a60b7c7cb7b" status: 200 len: 1577 microversion: 2.1 time: 0.218249 May 26 12:58:22.238837 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 511/1027] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:58:22 2022] GET /compute/v2.1/servers/6e0af4d0-3c35-4826-868b-6a60b7c7cb7b => generated 1577 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:58:22.861057 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [req-f06d8f1b-552d-48bf-b50b-cfbe5ed750f2 req-e0801236-2c33-4fce-8c51-7b9dc1fc9601 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e0af4d0-3c35-4826-868b-6a60b7c7cb7b", "name": "network-vif-deleted", "tag": "2b014596-4175-45bc-ae4e-056fcfa9a229"}]} {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:58:22.870452 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [req-f06d8f1b-552d-48bf-b50b-cfbe5ed750f2 req-e0801236-2c33-4fce-8c51-7b9dc1fc9601 service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:58:22.870896 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [req-f06d8f1b-552d-48bf-b50b-cfbe5ed750f2 req-e0801236-2c33-4fce-8c51-7b9dc1fc9601 service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:58:22.888394 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.compute.server_external_events [req-f06d8f1b-552d-48bf-b50b-cfbe5ed750f2 req-e0801236-2c33-4fce-8c51-7b9dc1fc9601 service nova] Creating event network-vif-deleted:2b014596-4175-45bc-ae4e-056fcfa9a229 for instance 6e0af4d0-3c35-4826-868b-6a60b7c7cb7b on hv-cinder-81571 May 26 12:58:22.893385 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [req-f06d8f1b-552d-48bf-b50b-cfbe5ed750f2 req-e0801236-2c33-4fce-8c51-7b9dc1fc9601 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035969 May 26 12:58:22.894087 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 517/1028] 10.222.0.41 () {64 vars in 1317 bytes} [Thu May 26 12:58:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:58:23.255841 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-6e3401e3-5665-4882-929c-a07e7b8a36af tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:58:23.257133 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-6e3401e3-5665-4882-929c-a07e7b8a36af tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] [instance: 6e0af4d0-3c35-4826-868b-6a60b7c7cb7b] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:58:23.263995 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-6e3401e3-5665-4882-929c-a07e7b8a36af tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:58:23.264443 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-6e3401e3-5665-4882-929c-a07e7b8a36af tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:58:23.265236 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-6e3401e3-5665-4882-929c-a07e7b8a36af tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:58:23.275974 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-6e3401e3-5665-4882-929c-a07e7b8a36af tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:58:23.335336 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-6e3401e3-5665-4882-929c-a07e7b8a36af tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47d51863b0448b880dc03b01dec6dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23568023763549669484e71430e34389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:58:23.343330 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-6e3401e3-5665-4882-929c-a07e7b8a36af tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] 10.222.0.41 "GET /compute/v2.1/servers/6e0af4d0-3c35-4826-868b-6a60b7c7cb7b" status: 200 len: 1226 microversion: 2.1 time: 0.091607 May 26 12:58:23.343906 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 512/1029] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:58:23 2022] GET /compute/v2.1/servers/6e0af4d0-3c35-4826-868b-6a60b7c7cb7b => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:58:24.361881 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-cb3d808e-ca88-43ee-a486-a3dfd52629d5 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:58:24.362555 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-cb3d808e-ca88-43ee-a486-a3dfd52629d5 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] [instance: 6e0af4d0-3c35-4826-868b-6a60b7c7cb7b] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:58:24.369329 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-cb3d808e-ca88-43ee-a486-a3dfd52629d5 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:58:24.369799 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-cb3d808e-ca88-43ee-a486-a3dfd52629d5 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:58:24.370554 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-cb3d808e-ca88-43ee-a486-a3dfd52629d5 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:58:24.370983 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-cb3d808e-ca88-43ee-a486-a3dfd52629d5 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:58:24.384705 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.wsgi [None req-cb3d808e-ca88-43ee-a486-a3dfd52629d5 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] HTTP exception thrown: Instance 6e0af4d0-3c35-4826-868b-6a60b7c7cb7b could not be found. May 26 12:58:24.386340 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-cb3d808e-ca88-43ee-a486-a3dfd52629d5 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Request method failure captured: May 26 12:58:24.386340 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: request: GET /compute/v2.1/servers/6e0af4d0-3c35-4826-868b-6a60b7c7cb7b HTTP/1.1 May 26 12:58:24.386340 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Accept: application/json May 26 12:58:24.386340 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Accept-Encoding: identity May 26 12:58:24.386340 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Connection: close May 26 12:58:24.386340 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Content-Length: 0 May 26 12:58:24.386340 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Content-Type: application/json May 26 12:58:24.386340 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Host: 10.222.0.41 May 26 12:58:24.386340 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Openstack-System-Scope: None May 26 12:58:24.386340 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: User-Agent: python-urllib3/1.26.9 May 26 12:58:24.386340 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Auth-Token: gAAAAABij3ex2rFQ9UlBXFi2IjYGXp-kvvCAfc50TLy59CDxGhP1PTEuOfA2BJ0_RUfoFDTNs98Le9vda0LdfrJuZMS_aSN6bLCCFV-QhSBlSdomQU4bOs98p0gOa5IZdVXyQcqQbgwz8rl9id91HXdLeRvyznNbALhgY6xV6IqlhG0RBsHuSss May 26 12:58:24.386340 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Domain-Id: None May 26 12:58:24.386340 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Domain-Name: None May 26 12:58:24.386340 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Identity-Status: Confirmed May 26 12:58:24.386340 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Is-Admin-Project: True May 26 12:58:24.386340 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Domain-Id: default May 26 12:58:24.386340 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Domain-Name: Default May 26 12:58:24.386340 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Id: 23568023763549669484e71430e34389 May 26 12:58:24.386340 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Name: tempest-TestVolumeBootPattern-1570249511 May 26 12:58:24.386340 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Role: member,reader May 26 12:58:24.386340 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Roles: member,reader May 26 12:58:24.388738 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/23568023763549669484e71430e34389"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/23568023763549669484e71430e34389"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/23568023763549669484e71430e34389"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_23568023763549669484e71430e34389", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 26 12:58:24.388738 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Tenant: tempest-TestVolumeBootPattern-1570249511 May 26 12:58:24.388738 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Tenant-Id: 23568023763549669484e71430e34389 May 26 12:58:24.388738 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Tenant-Name: tempest-TestVolumeBootPattern-1570249511 May 26 12:58:24.388738 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User: tempest-TestVolumeBootPattern-1570249511-project May 26 12:58:24.388738 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Domain-Id: default May 26 12:58:24.388738 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Domain-Name: Default May 26 12:58:24.388738 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Id: b47d51863b0448b880dc03b01dec6dc5 May 26 12:58:24.388738 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Name: tempest-TestVolumeBootPattern-1570249511-project May 26 12:58:24.388738 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: method: > May 26 12:58:24.388738 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: exception: Instance 6e0af4d0-3c35-4826-868b-6a60b7c7cb7b could not be found. May 26 12:58:24.388738 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: action_args: {'id': '6e0af4d0-3c35-4826-868b-6a60b7c7cb7b'} May 26 12:58:24.390293 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:58:24.390293 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:58:24.390293 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:58:24.390293 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:58:24.390293 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:58:24.390293 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:58:24.390293 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:58:24.390293 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:58:24.390293 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:58:24.390293 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:58:24.390293 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e0af4d0-3c35-4826-868b-6a60b7c7cb7b could not be found. May 26 12:58:24.390293 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:58:24.390293 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:58:24.390293 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:58:24.390293 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:58:24.390293 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:58:24.390293 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:58:24.390293 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:58:24.390293 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:58:24.390293 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:58:24.392752 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:58:24.392752 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 12:58:24.392752 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 12:58:24.392752 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:58:24.392752 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:58:24.392752 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:58:24.392752 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:58:24.392752 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e0af4d0-3c35-4826-868b-6a60b7c7cb7b could not be found. May 26 12:58:24.392752 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:58:24.392752 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:58:24.392752 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:58:24.392752 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:58:24.392752 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:58:24.392752 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:58:24.392752 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:58:24.392752 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:58:24.392752 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e0af4d0-3c35-4826-868b-6a60b7c7cb7b could not be found. May 26 12:58:24.392752 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:58:24.394959 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-cb3d808e-ca88-43ee-a486-a3dfd52629d5 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Returning 404 to user: Instance 6e0af4d0-3c35-4826-868b-6a60b7c7cb7b could not be found. {{(pid=124824) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:58:24.394959 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-cb3d808e-ca88-43ee-a486-a3dfd52629d5 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] 10.222.0.41 "GET /compute/v2.1/servers/6e0af4d0-3c35-4826-868b-6a60b7c7cb7b" status: 404 len: 111 microversion: 2.1 time: 0.030595 May 26 12:58:24.394959 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 518/1030] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:58:24 2022] GET /compute/v2.1/servers/6e0af4d0-3c35-4826-868b-6a60b7c7cb7b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:58:27.753343 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-7a64d143-0662-4f97-876f-05ba2bb57328 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:58:27.754497 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-7a64d143-0662-4f97-876f-05ba2bb57328 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] [instance: f24cf723-09f4-49a6-8e36-13cccb384169] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:58:27.755443 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [req-56064876-d153-4ba7-b2d6-9b2e5ffb9557 req-b0aa863e-a159-4071-949b-55a2694cf288 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f24cf723-09f4-49a6-8e36-13cccb384169", "tag": "d96fa6eb-c6ec-48b5-a0bf-bec9d462a6d5"}]} {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:58:27.761735 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-7a64d143-0662-4f97-876f-05ba2bb57328 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:58:27.762182 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-7a64d143-0662-4f97-876f-05ba2bb57328 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:58:27.762948 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-7a64d143-0662-4f97-876f-05ba2bb57328 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:58:27.763553 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-7a64d143-0662-4f97-876f-05ba2bb57328 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:58:27.765875 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [req-56064876-d153-4ba7-b2d6-9b2e5ffb9557 req-b0aa863e-a159-4071-949b-55a2694cf288 service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:58:27.766674 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [req-56064876-d153-4ba7-b2d6-9b2e5ffb9557 req-b0aa863e-a159-4071-949b-55a2694cf288 service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:58:27.782233 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.compute.server_external_events [req-56064876-d153-4ba7-b2d6-9b2e5ffb9557 req-b0aa863e-a159-4071-949b-55a2694cf288 service nova] Creating event network-changed:d96fa6eb-c6ec-48b5-a0bf-bec9d462a6d5 for instance f24cf723-09f4-49a6-8e36-13cccb384169 on hv-cinder-81571 May 26 12:58:27.787875 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [req-56064876-d153-4ba7-b2d6-9b2e5ffb9557 req-b0aa863e-a159-4071-949b-55a2694cf288 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036377 May 26 12:58:27.788757 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 519/1031] 10.222.0.41 () {64 vars in 1317 bytes} [Thu May 26 12:58:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:58:27.791237 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-7a64d143-0662-4f97-876f-05ba2bb57328 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] [instance: f24cf723-09f4-49a6-8e36-13cccb384169] Going to try to terminate instance {{(pid=124823) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 12:58:28.140317 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-7a64d143-0662-4f97-876f-05ba2bb57328 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] 10.222.0.41 "DELETE /compute/v2.1/servers/f24cf723-09f4-49a6-8e36-13cccb384169" status: 204 len: 0 microversion: 2.1 time: 0.390853 May 26 12:58:28.140940 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 513/1032] 10.222.0.41 () {58 vars in 1238 bytes} [Thu May 26 12:58:27 2022] DELETE /compute/v2.1/servers/f24cf723-09f4-49a6-8e36-13cccb384169 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 12:58:28.150700 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-886d3ab1-c6ff-4a3d-b780-ec26b4a3ff63 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:58:28.151529 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-886d3ab1-c6ff-4a3d-b780-ec26b4a3ff63 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] [instance: f24cf723-09f4-49a6-8e36-13cccb384169] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:58:28.158142 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-886d3ab1-c6ff-4a3d-b780-ec26b4a3ff63 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:58:28.158598 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-886d3ab1-c6ff-4a3d-b780-ec26b4a3ff63 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:58:28.159376 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-886d3ab1-c6ff-4a3d-b780-ec26b4a3ff63 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:58:28.159818 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-886d3ab1-c6ff-4a3d-b780-ec26b4a3ff63 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:58:28.296819 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-886d3ab1-c6ff-4a3d-b780-ec26b4a3ff63 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47d51863b0448b880dc03b01dec6dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23568023763549669484e71430e34389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:58:28.305250 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-886d3ab1-c6ff-4a3d-b780-ec26b4a3ff63 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] 10.222.0.41 "GET /compute/v2.1/servers/f24cf723-09f4-49a6-8e36-13cccb384169" status: 200 len: 1578 microversion: 2.1 time: 0.159340 May 26 12:58:28.305918 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 520/1033] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:58:28 2022] GET /compute/v2.1/servers/f24cf723-09f4-49a6-8e36-13cccb384169 => generated 1578 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:58:29.322891 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-bbc32c49-7956-4331-9a7c-f105fbbe2487 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:58:29.323618 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-bbc32c49-7956-4331-9a7c-f105fbbe2487 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] [instance: f24cf723-09f4-49a6-8e36-13cccb384169] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:58:29.330037 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-bbc32c49-7956-4331-9a7c-f105fbbe2487 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:58:29.330480 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-bbc32c49-7956-4331-9a7c-f105fbbe2487 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:58:29.331236 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-bbc32c49-7956-4331-9a7c-f105fbbe2487 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:58:29.331796 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-bbc32c49-7956-4331-9a7c-f105fbbe2487 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:58:29.469395 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-bbc32c49-7956-4331-9a7c-f105fbbe2487 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47d51863b0448b880dc03b01dec6dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23568023763549669484e71430e34389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:58:29.477803 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-bbc32c49-7956-4331-9a7c-f105fbbe2487 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] 10.222.0.41 "GET /compute/v2.1/servers/f24cf723-09f4-49a6-8e36-13cccb384169" status: 200 len: 1578 microversion: 2.1 time: 0.158969 May 26 12:58:29.478692 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 514/1034] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:58:29 2022] GET /compute/v2.1/servers/f24cf723-09f4-49a6-8e36-13cccb384169 => generated 1578 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:58:30.495143 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-a4ebddd1-a18d-464b-9848-7cbda7ac2fe3 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:58:30.495870 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-a4ebddd1-a18d-464b-9848-7cbda7ac2fe3 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] [instance: f24cf723-09f4-49a6-8e36-13cccb384169] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:58:30.502610 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-a4ebddd1-a18d-464b-9848-7cbda7ac2fe3 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:58:30.503140 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-a4ebddd1-a18d-464b-9848-7cbda7ac2fe3 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:58:30.503973 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-a4ebddd1-a18d-464b-9848-7cbda7ac2fe3 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:58:30.504415 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-a4ebddd1-a18d-464b-9848-7cbda7ac2fe3 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:58:30.641165 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-3b2a49ef-8c1a-40d9-8463-7c983c57f580 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:58:30.642198 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-3b2a49ef-8c1a-40d9-8463-7c983c57f580 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] [instance: 32d87977-fb85-4de5-96a8-e3b1cf8be517] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:58:30.649314 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-3b2a49ef-8c1a-40d9-8463-7c983c57f580 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:58:30.650084 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-3b2a49ef-8c1a-40d9-8463-7c983c57f580 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:58:30.650862 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-3b2a49ef-8c1a-40d9-8463-7c983c57f580 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:58:30.651304 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-3b2a49ef-8c1a-40d9-8463-7c983c57f580 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:58:30.682619 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-3b2a49ef-8c1a-40d9-8463-7c983c57f580 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] 10.222.0.41 "GET /compute/v2.1/servers/32d87977-fb85-4de5-96a8-e3b1cf8be517/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045409 May 26 12:58:30.683207 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 515/1035] 10.222.0.41 () {58 vars in 1301 bytes} [Thu May 26 12:58:30 2022] GET /compute/v2.1/servers/32d87977-fb85-4de5-96a8-e3b1cf8be517/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:58:30.715882 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-a4ebddd1-a18d-464b-9848-7cbda7ac2fe3 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47d51863b0448b880dc03b01dec6dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23568023763549669484e71430e34389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:58:30.724348 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-a4ebddd1-a18d-464b-9848-7cbda7ac2fe3 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] 10.222.0.41 "GET /compute/v2.1/servers/f24cf723-09f4-49a6-8e36-13cccb384169" status: 200 len: 1459 microversion: 2.1 time: 0.233555 May 26 12:58:30.724954 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 521/1036] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:58:30 2022] GET /compute/v2.1/servers/f24cf723-09f4-49a6-8e36-13cccb384169 => generated 1459 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:58:30.826399 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-ccf4cc52-8222-417f-ad09-2f81958a96b4 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:58:30.826895 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-ccf4cc52-8222-417f-ad09-2f81958a96b4 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] [instance: 32d87977-fb85-4de5-96a8-e3b1cf8be517] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:58:30.832982 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-ccf4cc52-8222-417f-ad09-2f81958a96b4 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:58:30.833438 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-ccf4cc52-8222-417f-ad09-2f81958a96b4 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:58:30.834250 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-ccf4cc52-8222-417f-ad09-2f81958a96b4 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:58:30.834687 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-ccf4cc52-8222-417f-ad09-2f81958a96b4 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:58:30.864856 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-ccf4cc52-8222-417f-ad09-2f81958a96b4 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] 10.222.0.41 "GET /compute/v2.1/servers/32d87977-fb85-4de5-96a8-e3b1cf8be517/os-volume_attachments/d156312c-a2f3-4c1d-9d0f-5146db7cb05a" status: 200 len: 194 microversion: 2.1 time: 0.042366 May 26 12:58:30.865449 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 516/1037] 10.222.0.41 () {58 vars in 1412 bytes} [Thu May 26 12:58:30 2022] GET /compute/v2.1/servers/32d87977-fb85-4de5-96a8-e3b1cf8be517/os-volume_attachments/d156312c-a2f3-4c1d-9d0f-5146db7cb05a => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:58:30.875798 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-4a457079-493e-4f1f-917f-be365a163a00 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:58:30.878131 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-4a457079-493e-4f1f-917f-be365a163a00 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] [instance: 32d87977-fb85-4de5-96a8-e3b1cf8be517] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:58:30.882564 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-4a457079-493e-4f1f-917f-be365a163a00 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:58:30.883041 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-4a457079-493e-4f1f-917f-be365a163a00 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:58:30.883806 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-4a457079-493e-4f1f-917f-be365a163a00 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:58:30.884246 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-4a457079-493e-4f1f-917f-be365a163a00 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:58:30.991805 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.objects.instance [None req-4a457079-493e-4f1f-917f-be365a163a00 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lazy-loading 'services' on Instance uuid 32d87977-fb85-4de5-96a8-e3b1cf8be517 {{(pid=124824) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:58:31.004200 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [req-b0814455-9333-406a-8dfd-585b6b16a2a7 req-01d11cde-ae42-431e-ab69-5c445d788470 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f24cf723-09f4-49a6-8e36-13cccb384169", "name": "network-vif-deleted", "tag": "d96fa6eb-c6ec-48b5-a0bf-bec9d462a6d5"}]} {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:58:31.012608 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [req-b0814455-9333-406a-8dfd-585b6b16a2a7 req-01d11cde-ae42-431e-ab69-5c445d788470 service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:58:31.013102 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [req-b0814455-9333-406a-8dfd-585b6b16a2a7 req-01d11cde-ae42-431e-ab69-5c445d788470 service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:58:31.025981 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.compute.server_external_events [req-b0814455-9333-406a-8dfd-585b6b16a2a7 req-01d11cde-ae42-431e-ab69-5c445d788470 service nova] Creating event network-vif-deleted:d96fa6eb-c6ec-48b5-a0bf-bec9d462a6d5 for instance f24cf723-09f4-49a6-8e36-13cccb384169 on hv-cinder-81571 May 26 12:58:31.029645 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [req-b0814455-9333-406a-8dfd-585b6b16a2a7 req-01d11cde-ae42-431e-ab69-5c445d788470 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028990 May 26 12:58:31.030253 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 517/1038] 10.222.0.41 () {64 vars in 1317 bytes} [Thu May 26 12:58:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:58:31.295501 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-4a457079-493e-4f1f-917f-be365a163a00 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] 10.222.0.41 "DELETE /compute/v2.1/servers/32d87977-fb85-4de5-96a8-e3b1cf8be517/os-volume_attachments/d156312c-a2f3-4c1d-9d0f-5146db7cb05a" status: 202 len: 0 microversion: 2.1 time: 0.423125 May 26 12:58:31.299157 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 522/1039] 10.222.0.41 () {58 vars in 1415 bytes} [Thu May 26 12:58:30 2022] DELETE /compute/v2.1/servers/32d87977-fb85-4de5-96a8-e3b1cf8be517/os-volume_attachments/d156312c-a2f3-4c1d-9d0f-5146db7cb05a => generated 0 bytes in 425 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 12:58:31.744500 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-da6811d0-476a-44c4-8bd7-c36f727abbce tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:58:31.745150 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-da6811d0-476a-44c4-8bd7-c36f727abbce tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] [instance: f24cf723-09f4-49a6-8e36-13cccb384169] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:58:31.751620 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-da6811d0-476a-44c4-8bd7-c36f727abbce tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:58:31.752073 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-da6811d0-476a-44c4-8bd7-c36f727abbce tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:58:31.752848 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-da6811d0-476a-44c4-8bd7-c36f727abbce tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:58:31.753302 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-da6811d0-476a-44c4-8bd7-c36f727abbce tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:58:31.785762 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-da6811d0-476a-44c4-8bd7-c36f727abbce tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:58:31.786227 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-da6811d0-476a-44c4-8bd7-c36f727abbce tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:58:31.786668 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.objects.instance [None req-da6811d0-476a-44c4-8bd7-c36f727abbce tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lazy-loading 'fault' on Instance uuid f24cf723-09f4-49a6-8e36-13cccb384169 {{(pid=124823) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:58:31.828870 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-da6811d0-476a-44c4-8bd7-c36f727abbce tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47d51863b0448b880dc03b01dec6dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23568023763549669484e71430e34389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:58:31.836546 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-da6811d0-476a-44c4-8bd7-c36f727abbce tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] 10.222.0.41 "GET /compute/v2.1/servers/f24cf723-09f4-49a6-8e36-13cccb384169" status: 200 len: 1230 microversion: 2.1 time: 0.096783 May 26 12:58:31.837111 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 518/1040] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:58:31 2022] GET /compute/v2.1/servers/f24cf723-09f4-49a6-8e36-13cccb384169 => generated 1230 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:58:32.857913 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-a7a382fc-9f60-462a-b0bc-35c8fb213839 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:58:32.858625 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-a7a382fc-9f60-462a-b0bc-35c8fb213839 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] [instance: f24cf723-09f4-49a6-8e36-13cccb384169] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:58:32.864929 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-a7a382fc-9f60-462a-b0bc-35c8fb213839 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:58:32.865363 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-a7a382fc-9f60-462a-b0bc-35c8fb213839 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:58:32.866159 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-a7a382fc-9f60-462a-b0bc-35c8fb213839 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:58:32.866594 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-a7a382fc-9f60-462a-b0bc-35c8fb213839 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:58:32.879686 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.wsgi [None req-a7a382fc-9f60-462a-b0bc-35c8fb213839 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] HTTP exception thrown: Instance f24cf723-09f4-49a6-8e36-13cccb384169 could not be found. May 26 12:58:32.881303 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-a7a382fc-9f60-462a-b0bc-35c8fb213839 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Request method failure captured: May 26 12:58:32.881303 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: request: GET /compute/v2.1/servers/f24cf723-09f4-49a6-8e36-13cccb384169 HTTP/1.1 May 26 12:58:32.881303 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Accept: application/json May 26 12:58:32.881303 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Accept-Encoding: identity May 26 12:58:32.881303 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Connection: close May 26 12:58:32.881303 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Content-Length: 0 May 26 12:58:32.881303 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Content-Type: application/json May 26 12:58:32.881303 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Host: 10.222.0.41 May 26 12:58:32.881303 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Openstack-System-Scope: None May 26 12:58:32.881303 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: User-Agent: python-urllib3/1.26.9 May 26 12:58:32.881303 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Auth-Token: gAAAAABij3ex2rFQ9UlBXFi2IjYGXp-kvvCAfc50TLy59CDxGhP1PTEuOfA2BJ0_RUfoFDTNs98Le9vda0LdfrJuZMS_aSN6bLCCFV-QhSBlSdomQU4bOs98p0gOa5IZdVXyQcqQbgwz8rl9id91HXdLeRvyznNbALhgY6xV6IqlhG0RBsHuSss May 26 12:58:32.881303 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Domain-Id: None May 26 12:58:32.881303 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Domain-Name: None May 26 12:58:32.881303 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Identity-Status: Confirmed May 26 12:58:32.881303 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Is-Admin-Project: True May 26 12:58:32.881303 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Domain-Id: default May 26 12:58:32.881303 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Domain-Name: Default May 26 12:58:32.881303 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Id: 23568023763549669484e71430e34389 May 26 12:58:32.881303 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Name: tempest-TestVolumeBootPattern-1570249511 May 26 12:58:32.881303 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Role: member,reader May 26 12:58:32.881303 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Roles: member,reader May 26 12:58:32.882975 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/23568023763549669484e71430e34389"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/23568023763549669484e71430e34389"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/23568023763549669484e71430e34389"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_23568023763549669484e71430e34389", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 26 12:58:32.882975 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Tenant: tempest-TestVolumeBootPattern-1570249511 May 26 12:58:32.882975 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Tenant-Id: 23568023763549669484e71430e34389 May 26 12:58:32.882975 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Tenant-Name: tempest-TestVolumeBootPattern-1570249511 May 26 12:58:32.882975 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User: tempest-TestVolumeBootPattern-1570249511-project May 26 12:58:32.882975 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Domain-Id: default May 26 12:58:32.882975 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Domain-Name: Default May 26 12:58:32.882975 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Id: b47d51863b0448b880dc03b01dec6dc5 May 26 12:58:32.882975 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Name: tempest-TestVolumeBootPattern-1570249511-project May 26 12:58:32.882975 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: method: > May 26 12:58:32.882975 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: exception: Instance f24cf723-09f4-49a6-8e36-13cccb384169 could not be found. May 26 12:58:32.882975 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: action_args: {'id': 'f24cf723-09f4-49a6-8e36-13cccb384169'} May 26 12:58:32.883806 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:58:32.883806 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:58:32.883806 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:58:32.883806 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:58:32.883806 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:58:32.883806 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:58:32.883806 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:58:32.883806 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:58:32.883806 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:58:32.883806 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:58:32.883806 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f24cf723-09f4-49a6-8e36-13cccb384169 could not be found. May 26 12:58:32.883806 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:58:32.883806 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:58:32.883806 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:58:32.883806 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:58:32.883806 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:58:32.883806 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:58:32.883806 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:58:32.883806 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:58:32.883806 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:58:32.885013 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:58:32.885013 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 12:58:32.885013 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 12:58:32.885013 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:58:32.885013 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:58:32.885013 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:58:32.885013 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:58:32.885013 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f24cf723-09f4-49a6-8e36-13cccb384169 could not be found. May 26 12:58:32.885013 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:58:32.885013 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:58:32.885013 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:58:32.885013 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:58:32.885013 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:58:32.885013 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:58:32.885013 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:58:32.885013 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:58:32.885013 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f24cf723-09f4-49a6-8e36-13cccb384169 could not be found. May 26 12:58:32.885013 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:58:32.886298 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-a7a382fc-9f60-462a-b0bc-35c8fb213839 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Returning 404 to user: Instance f24cf723-09f4-49a6-8e36-13cccb384169 could not be found. {{(pid=124824) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:58:32.886298 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-a7a382fc-9f60-462a-b0bc-35c8fb213839 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] 10.222.0.41 "GET /compute/v2.1/servers/f24cf723-09f4-49a6-8e36-13cccb384169" status: 404 len: 111 microversion: 2.1 time: 0.032390 May 26 12:58:32.886298 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 523/1041] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:58:32 2022] GET /compute/v2.1/servers/f24cf723-09f4-49a6-8e36-13cccb384169 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:58:33.410975 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-8d68fccd-d347-41f1-b44e-afac6dc27bb5 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:58:33.411483 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-8d68fccd-d347-41f1-b44e-afac6dc27bb5 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] [instance: 2b1f3f01-d549-4e51-ae06-24500312482c] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:58:33.418179 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-8d68fccd-d347-41f1-b44e-afac6dc27bb5 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:58:33.418635 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-8d68fccd-d347-41f1-b44e-afac6dc27bb5 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:58:33.419410 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-8d68fccd-d347-41f1-b44e-afac6dc27bb5 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:58:33.419850 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-8d68fccd-d347-41f1-b44e-afac6dc27bb5 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:58:33.434060 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.wsgi [None req-8d68fccd-d347-41f1-b44e-afac6dc27bb5 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] HTTP exception thrown: Instance 2b1f3f01-d549-4e51-ae06-24500312482c could not be found. May 26 12:58:33.435743 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-8d68fccd-d347-41f1-b44e-afac6dc27bb5 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Request method failure captured: May 26 12:58:33.435743 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: request: DELETE /compute/v2.1/servers/2b1f3f01-d549-4e51-ae06-24500312482c HTTP/1.1 May 26 12:58:33.435743 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Accept: application/json May 26 12:58:33.435743 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Accept-Encoding: identity May 26 12:58:33.435743 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Connection: close May 26 12:58:33.435743 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Content-Length: 0 May 26 12:58:33.435743 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Content-Type: application/json May 26 12:58:33.435743 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Host: 10.222.0.41 May 26 12:58:33.435743 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Openstack-System-Scope: None May 26 12:58:33.435743 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: User-Agent: python-urllib3/1.26.9 May 26 12:58:33.435743 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Auth-Token: gAAAAABij3ex2rFQ9UlBXFi2IjYGXp-kvvCAfc50TLy59CDxGhP1PTEuOfA2BJ0_RUfoFDTNs98Le9vda0LdfrJuZMS_aSN6bLCCFV-QhSBlSdomQU4bOs98p0gOa5IZdVXyQcqQbgwz8rl9id91HXdLeRvyznNbALhgY6xV6IqlhG0RBsHuSss May 26 12:58:33.435743 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Domain-Id: None May 26 12:58:33.435743 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Domain-Name: None May 26 12:58:33.435743 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Identity-Status: Confirmed May 26 12:58:33.435743 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Is-Admin-Project: True May 26 12:58:33.435743 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Project-Domain-Id: default May 26 12:58:33.435743 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Project-Domain-Name: Default May 26 12:58:33.435743 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Project-Id: 23568023763549669484e71430e34389 May 26 12:58:33.435743 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Project-Name: tempest-TestVolumeBootPattern-1570249511 May 26 12:58:33.435743 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Role: member,reader May 26 12:58:33.435743 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Roles: member,reader May 26 12:58:33.437347 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/23568023763549669484e71430e34389"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/23568023763549669484e71430e34389"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/23568023763549669484e71430e34389"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_23568023763549669484e71430e34389", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 26 12:58:33.437347 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Tenant: tempest-TestVolumeBootPattern-1570249511 May 26 12:58:33.437347 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Tenant-Id: 23568023763549669484e71430e34389 May 26 12:58:33.437347 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Tenant-Name: tempest-TestVolumeBootPattern-1570249511 May 26 12:58:33.437347 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User: tempest-TestVolumeBootPattern-1570249511-project May 26 12:58:33.437347 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User-Domain-Id: default May 26 12:58:33.437347 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User-Domain-Name: Default May 26 12:58:33.437347 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User-Id: b47d51863b0448b880dc03b01dec6dc5 May 26 12:58:33.437347 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User-Name: tempest-TestVolumeBootPattern-1570249511-project May 26 12:58:33.437347 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: method: > May 26 12:58:33.437347 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: exception: Instance 2b1f3f01-d549-4e51-ae06-24500312482c could not be found. May 26 12:58:33.437347 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: action_args: {'id': '2b1f3f01-d549-4e51-ae06-24500312482c'} May 26 12:58:33.438410 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:58:33.438410 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:58:33.438410 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:58:33.438410 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:58:33.438410 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:58:33.438410 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:58:33.438410 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:58:33.438410 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:58:33.438410 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:58:33.438410 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:58:33.438410 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b1f3f01-d549-4e51-ae06-24500312482c could not be found. May 26 12:58:33.438410 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:58:33.438410 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:58:33.438410 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:58:33.438410 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:58:33.438410 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:58:33.438410 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:58:33.438410 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:58:33.438410 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:58:33.438410 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:58:33.440024 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:58:33.440024 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 12:58:33.440024 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 12:58:33.440024 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 12:58:33.440024 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 12:58:33.440024 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:58:33.440024 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:58:33.440024 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:58:33.440024 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:58:33.440024 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b1f3f01-d549-4e51-ae06-24500312482c could not be found. May 26 12:58:33.440024 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:58:33.440024 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:58:33.440024 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:58:33.440024 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:58:33.440024 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:58:33.440024 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:58:33.440024 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:58:33.440024 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:58:33.440024 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b1f3f01-d549-4e51-ae06-24500312482c could not be found. May 26 12:58:33.440024 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:58:33.441751 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-8d68fccd-d347-41f1-b44e-afac6dc27bb5 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Returning 404 to user: Instance 2b1f3f01-d549-4e51-ae06-24500312482c could not be found. {{(pid=124823) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:58:33.441751 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-8d68fccd-d347-41f1-b44e-afac6dc27bb5 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] 10.222.0.41 "DELETE /compute/v2.1/servers/2b1f3f01-d549-4e51-ae06-24500312482c" status: 404 len: 111 microversion: 2.1 time: 0.030178 May 26 12:58:33.441751 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 519/1042] 10.222.0.41 () {58 vars in 1238 bytes} [Thu May 26 12:58:33 2022] DELETE /compute/v2.1/servers/2b1f3f01-d549-4e51-ae06-24500312482c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:58:33.447519 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-9b001449-1219-49fa-8cc8-c520ddef187d tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:58:33.448130 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-9b001449-1219-49fa-8cc8-c520ddef187d tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] [instance: 2b1f3f01-d549-4e51-ae06-24500312482c] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:58:33.454266 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-9b001449-1219-49fa-8cc8-c520ddef187d tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:58:33.454708 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-9b001449-1219-49fa-8cc8-c520ddef187d tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:58:33.455468 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-9b001449-1219-49fa-8cc8-c520ddef187d tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:58:33.455901 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-9b001449-1219-49fa-8cc8-c520ddef187d tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:58:33.469697 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.wsgi [None req-9b001449-1219-49fa-8cc8-c520ddef187d tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] HTTP exception thrown: Instance 2b1f3f01-d549-4e51-ae06-24500312482c could not be found. May 26 12:58:33.471269 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-9b001449-1219-49fa-8cc8-c520ddef187d tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Request method failure captured: May 26 12:58:33.471269 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: request: GET /compute/v2.1/servers/2b1f3f01-d549-4e51-ae06-24500312482c HTTP/1.1 May 26 12:58:33.471269 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Accept: application/json May 26 12:58:33.471269 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Accept-Encoding: identity May 26 12:58:33.471269 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Connection: close May 26 12:58:33.471269 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Content-Length: 0 May 26 12:58:33.471269 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Content-Type: application/json May 26 12:58:33.471269 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Host: 10.222.0.41 May 26 12:58:33.471269 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Openstack-System-Scope: None May 26 12:58:33.471269 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: User-Agent: python-urllib3/1.26.9 May 26 12:58:33.471269 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Auth-Token: gAAAAABij3ex2rFQ9UlBXFi2IjYGXp-kvvCAfc50TLy59CDxGhP1PTEuOfA2BJ0_RUfoFDTNs98Le9vda0LdfrJuZMS_aSN6bLCCFV-QhSBlSdomQU4bOs98p0gOa5IZdVXyQcqQbgwz8rl9id91HXdLeRvyznNbALhgY6xV6IqlhG0RBsHuSss May 26 12:58:33.471269 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Domain-Id: None May 26 12:58:33.471269 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Domain-Name: None May 26 12:58:33.471269 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Identity-Status: Confirmed May 26 12:58:33.471269 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Is-Admin-Project: True May 26 12:58:33.471269 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Domain-Id: default May 26 12:58:33.471269 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Domain-Name: Default May 26 12:58:33.471269 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Id: 23568023763549669484e71430e34389 May 26 12:58:33.471269 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Name: tempest-TestVolumeBootPattern-1570249511 May 26 12:58:33.471269 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Role: member,reader May 26 12:58:33.471269 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Roles: member,reader May 26 12:58:33.472905 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/23568023763549669484e71430e34389"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/23568023763549669484e71430e34389"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/23568023763549669484e71430e34389"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_23568023763549669484e71430e34389", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 26 12:58:33.472905 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Tenant: tempest-TestVolumeBootPattern-1570249511 May 26 12:58:33.472905 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Tenant-Id: 23568023763549669484e71430e34389 May 26 12:58:33.472905 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Tenant-Name: tempest-TestVolumeBootPattern-1570249511 May 26 12:58:33.472905 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User: tempest-TestVolumeBootPattern-1570249511-project May 26 12:58:33.472905 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Domain-Id: default May 26 12:58:33.472905 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Domain-Name: Default May 26 12:58:33.472905 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Id: b47d51863b0448b880dc03b01dec6dc5 May 26 12:58:33.472905 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Name: tempest-TestVolumeBootPattern-1570249511-project May 26 12:58:33.472905 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: method: > May 26 12:58:33.472905 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: exception: Instance 2b1f3f01-d549-4e51-ae06-24500312482c could not be found. May 26 12:58:33.472905 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: action_args: {'id': '2b1f3f01-d549-4e51-ae06-24500312482c'} May 26 12:58:33.474056 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:58:33.474056 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:58:33.474056 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:58:33.474056 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:58:33.474056 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:58:33.474056 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:58:33.474056 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:58:33.474056 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:58:33.474056 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:58:33.474056 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:58:33.474056 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b1f3f01-d549-4e51-ae06-24500312482c could not be found. May 26 12:58:33.474056 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:58:33.474056 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:58:33.474056 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:58:33.474056 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:58:33.474056 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:58:33.474056 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:58:33.474056 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:58:33.474056 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:58:33.474056 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:58:33.475539 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:58:33.475539 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 12:58:33.475539 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 12:58:33.475539 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:58:33.475539 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:58:33.475539 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:58:33.475539 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:58:33.475539 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b1f3f01-d549-4e51-ae06-24500312482c could not be found. May 26 12:58:33.475539 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:58:33.475539 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:58:33.475539 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:58:33.475539 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:58:33.475539 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:58:33.475539 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:58:33.475539 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:58:33.475539 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:58:33.475539 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b1f3f01-d549-4e51-ae06-24500312482c could not be found. May 26 12:58:33.475539 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:58:33.477044 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-9b001449-1219-49fa-8cc8-c520ddef187d tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Returning 404 to user: Instance 2b1f3f01-d549-4e51-ae06-24500312482c could not be found. {{(pid=124824) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:58:33.477135 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-12ccb9a2-929d-4828-8a0b-6f131d614086 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:58:33.477135 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-12ccb9a2-929d-4828-8a0b-6f131d614086 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] [instance: 32d87977-fb85-4de5-96a8-e3b1cf8be517] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:58:33.477341 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-9b001449-1219-49fa-8cc8-c520ddef187d tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] 10.222.0.41 "GET /compute/v2.1/servers/2b1f3f01-d549-4e51-ae06-24500312482c" status: 404 len: 111 microversion: 2.1 time: 0.029514 May 26 12:58:33.477341 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 524/1043] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:58:33 2022] GET /compute/v2.1/servers/2b1f3f01-d549-4e51-ae06-24500312482c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:58:33.481686 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-12ccb9a2-929d-4828-8a0b-6f131d614086 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:58:33.482153 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-12ccb9a2-929d-4828-8a0b-6f131d614086 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:58:33.482973 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-12ccb9a2-929d-4828-8a0b-6f131d614086 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:58:33.483426 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-12ccb9a2-929d-4828-8a0b-6f131d614086 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:58:33.513217 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-12ccb9a2-929d-4828-8a0b-6f131d614086 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] 10.222.0.41 "GET /compute/v2.1/servers/32d87977-fb85-4de5-96a8-e3b1cf8be517/os-volume_attachments/b77837a8-db8a-462d-a345-2295b71582ca" status: 200 len: 194 microversion: 2.1 time: 0.045130 May 26 12:58:33.513832 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 520/1044] 10.222.0.41 () {58 vars in 1412 bytes} [Thu May 26 12:58:33 2022] GET /compute/v2.1/servers/32d87977-fb85-4de5-96a8-e3b1cf8be517/os-volume_attachments/b77837a8-db8a-462d-a345-2295b71582ca => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:58:33.523956 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-4be88741-4e31-4908-a8b5-9e6c30f2936f tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:58:33.524449 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-4be88741-4e31-4908-a8b5-9e6c30f2936f tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] [instance: 32d87977-fb85-4de5-96a8-e3b1cf8be517] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:58:33.530559 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-4be88741-4e31-4908-a8b5-9e6c30f2936f tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:58:33.531005 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-4be88741-4e31-4908-a8b5-9e6c30f2936f tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:58:33.532601 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-4be88741-4e31-4908-a8b5-9e6c30f2936f tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:58:33.532601 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-4be88741-4e31-4908-a8b5-9e6c30f2936f tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:58:33.614398 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.objects.instance [None req-4be88741-4e31-4908-a8b5-9e6c30f2936f tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lazy-loading 'services' on Instance uuid 32d87977-fb85-4de5-96a8-e3b1cf8be517 {{(pid=124824) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:58:33.826186 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-4be88741-4e31-4908-a8b5-9e6c30f2936f tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] 10.222.0.41 "DELETE /compute/v2.1/servers/32d87977-fb85-4de5-96a8-e3b1cf8be517/os-volume_attachments/b77837a8-db8a-462d-a345-2295b71582ca" status: 202 len: 0 microversion: 2.1 time: 0.306357 May 26 12:58:33.827087 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 525/1045] 10.222.0.41 () {58 vars in 1415 bytes} [Thu May 26 12:58:33 2022] DELETE /compute/v2.1/servers/32d87977-fb85-4de5-96a8-e3b1cf8be517/os-volume_attachments/b77837a8-db8a-462d-a345-2295b71582ca => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 26 12:58:34.991199 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-aa399029-d7e0-421b-9b5a-96ed63cec398 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:58:34.993894 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-aa399029-d7e0-421b-9b5a-96ed63cec398 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] [instance: 32d87977-fb85-4de5-96a8-e3b1cf8be517] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:58:34.999160 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-aa399029-d7e0-421b-9b5a-96ed63cec398 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:58:34.999611 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-aa399029-d7e0-421b-9b5a-96ed63cec398 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:58:35.000461 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-aa399029-d7e0-421b-9b5a-96ed63cec398 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:58:35.000824 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-aa399029-d7e0-421b-9b5a-96ed63cec398 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:58:35.031312 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-aa399029-d7e0-421b-9b5a-96ed63cec398 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] 10.222.0.41 "GET /compute/v2.1/servers/32d87977-fb85-4de5-96a8-e3b1cf8be517/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044124 May 26 12:58:35.031924 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-8d503939-bd4d-41b2-9101-e6b44344cd66 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] Calling method '.version_select at 0x7f26a1f3c430>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:58:35.032398 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 521/1046] 10.222.0.41 () {58 vars in 1301 bytes} [Thu May 26 12:58:34 2022] GET /compute/v2.1/servers/32d87977-fb85-4de5-96a8-e3b1cf8be517/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 12:58:35.139287 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-8d503939-bd4d-41b2-9101-e6b44344cd66 tempest-TestVolumeBootPattern-1570249511 tempest-TestVolumeBootPattern-1570249511-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1054937962" status: 202 len: 0 microversion: 2.1 time: 0.111664 May 26 12:58:35.139864 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 526/1047] 10.222.0.41 () {58 vars in 1262 bytes} [Thu May 26 12:58:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1054937962 => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 26 12:58:35.141558 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-4591c776-5cc3-447c-9c51-a607e4d38ed0 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:58:35.143819 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-4591c776-5cc3-447c-9c51-a607e4d38ed0 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] [instance: 32d87977-fb85-4de5-96a8-e3b1cf8be517] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:58:35.150653 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-4591c776-5cc3-447c-9c51-a607e4d38ed0 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:58:35.156165 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-4591c776-5cc3-447c-9c51-a607e4d38ed0 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:58:35.156165 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-4591c776-5cc3-447c-9c51-a607e4d38ed0 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:58:35.156165 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-4591c776-5cc3-447c-9c51-a607e4d38ed0 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:58:35.167076 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG dbcounter [-] [124823] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:58:35.184189 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-4591c776-5cc3-447c-9c51-a607e4d38ed0 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] 10.222.0.41 "GET /compute/v2.1/servers/32d87977-fb85-4de5-96a8-e3b1cf8be517/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047281 May 26 12:58:35.184717 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 522/1048] 10.222.0.41 () {58 vars in 1301 bytes} [Thu May 26 12:58:35 2022] GET /compute/v2.1/servers/32d87977-fb85-4de5-96a8-e3b1cf8be517/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 26 12:58:35.251959 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-64b88a38-ed61-4c32-b449-3acb6c86e041 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:58:35.253779 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-64b88a38-ed61-4c32-b449-3acb6c86e041 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] [instance: 32d87977-fb85-4de5-96a8-e3b1cf8be517] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:58:35.260463 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-64b88a38-ed61-4c32-b449-3acb6c86e041 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:58:35.260917 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-64b88a38-ed61-4c32-b449-3acb6c86e041 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:58:35.261799 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-64b88a38-ed61-4c32-b449-3acb6c86e041 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:58:35.262235 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-64b88a38-ed61-4c32-b449-3acb6c86e041 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:58:35.289847 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-64b88a38-ed61-4c32-b449-3acb6c86e041 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] [instance: 32d87977-fb85-4de5-96a8-e3b1cf8be517] Going to try to terminate instance {{(pid=124824) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 12:58:35.458290 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG dbcounter [-] [124824] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=124824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:58:35.675258 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-64b88a38-ed61-4c32-b449-3acb6c86e041 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] 10.222.0.41 "DELETE /compute/v2.1/servers/32d87977-fb85-4de5-96a8-e3b1cf8be517" status: 204 len: 0 microversion: 2.1 time: 0.427680 May 26 12:58:35.676319 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 527/1049] 10.222.0.41 () {58 vars in 1238 bytes} [Thu May 26 12:58:35 2022] DELETE /compute/v2.1/servers/32d87977-fb85-4de5-96a8-e3b1cf8be517 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 12:58:35.684124 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-b848783f-e3d5-4131-852b-e87a14d081c0 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:58:35.684735 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-b848783f-e3d5-4131-852b-e87a14d081c0 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] [instance: 32d87977-fb85-4de5-96a8-e3b1cf8be517] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:58:35.691593 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-b848783f-e3d5-4131-852b-e87a14d081c0 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:58:35.692030 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-b848783f-e3d5-4131-852b-e87a14d081c0 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:58:35.692798 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-b848783f-e3d5-4131-852b-e87a14d081c0 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:58:35.693275 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-b848783f-e3d5-4131-852b-e87a14d081c0 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:58:35.823871 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-b848783f-e3d5-4131-852b-e87a14d081c0 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa52505a079041efbbf14fb04da7ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe580a28eae4195be1491ac29d373a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:58:35.831750 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-b848783f-e3d5-4131-852b-e87a14d081c0 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] 10.222.0.41 "GET /compute/v2.1/servers/32d87977-fb85-4de5-96a8-e3b1cf8be517" status: 200 len: 1673 microversion: 2.1 time: 0.151456 May 26 12:58:35.832470 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 523/1050] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:58:35 2022] GET /compute/v2.1/servers/32d87977-fb85-4de5-96a8-e3b1cf8be517 => generated 1673 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:58:36.852835 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-1cdf0218-6f05-43ca-91a3-f723f816c19f tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:58:36.853540 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-1cdf0218-6f05-43ca-91a3-f723f816c19f tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] [instance: 32d87977-fb85-4de5-96a8-e3b1cf8be517] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:58:36.860008 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-1cdf0218-6f05-43ca-91a3-f723f816c19f tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:58:36.860457 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-1cdf0218-6f05-43ca-91a3-f723f816c19f tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:58:36.861229 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-1cdf0218-6f05-43ca-91a3-f723f816c19f tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:58:36.861681 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-1cdf0218-6f05-43ca-91a3-f723f816c19f tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:58:37.044427 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-1cdf0218-6f05-43ca-91a3-f723f816c19f tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa52505a079041efbbf14fb04da7ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe580a28eae4195be1491ac29d373a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:58:37.061235 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-1cdf0218-6f05-43ca-91a3-f723f816c19f tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] 10.222.0.41 "GET /compute/v2.1/servers/32d87977-fb85-4de5-96a8-e3b1cf8be517" status: 200 len: 1673 microversion: 2.1 time: 0.214466 May 26 12:58:37.066320 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 528/1051] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:58:36 2022] GET /compute/v2.1/servers/32d87977-fb85-4de5-96a8-e3b1cf8be517 => generated 1673 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:58:38.078792 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-36265fac-fe6e-4e5a-83d2-9d1903f0582e tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:58:38.079740 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-36265fac-fe6e-4e5a-83d2-9d1903f0582e tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] [instance: 32d87977-fb85-4de5-96a8-e3b1cf8be517] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:58:38.093416 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-36265fac-fe6e-4e5a-83d2-9d1903f0582e tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:58:38.093416 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-36265fac-fe6e-4e5a-83d2-9d1903f0582e tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:58:38.093416 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-36265fac-fe6e-4e5a-83d2-9d1903f0582e tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:58:38.093416 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-36265fac-fe6e-4e5a-83d2-9d1903f0582e tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:58:38.157941 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-36265fac-fe6e-4e5a-83d2-9d1903f0582e tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa52505a079041efbbf14fb04da7ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe580a28eae4195be1491ac29d373a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:58:38.164682 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-36265fac-fe6e-4e5a-83d2-9d1903f0582e tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] 10.222.0.41 "GET /compute/v2.1/servers/32d87977-fb85-4de5-96a8-e3b1cf8be517" status: 200 len: 1606 microversion: 2.1 time: 0.089402 May 26 12:58:38.165294 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 524/1052] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:58:38 2022] GET /compute/v2.1/servers/32d87977-fb85-4de5-96a8-e3b1cf8be517 => generated 1606 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:58:38.522100 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [req-9ff5b4f3-3527-47dc-9880-3728d7991e65 req-d1afdd8c-c90d-4270-8f91-31d4f08a8b63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32d87977-fb85-4de5-96a8-e3b1cf8be517", "name": "network-vif-deleted", "tag": "e2b7f26f-96f3-4216-ade5-57d6f67846db"}]} {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:58:38.531583 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [req-9ff5b4f3-3527-47dc-9880-3728d7991e65 req-d1afdd8c-c90d-4270-8f91-31d4f08a8b63 service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:58:38.534121 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [req-9ff5b4f3-3527-47dc-9880-3728d7991e65 req-d1afdd8c-c90d-4270-8f91-31d4f08a8b63 service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:58:38.558341 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.compute.server_external_events [req-9ff5b4f3-3527-47dc-9880-3728d7991e65 req-d1afdd8c-c90d-4270-8f91-31d4f08a8b63 service nova] Creating event network-vif-deleted:e2b7f26f-96f3-4216-ade5-57d6f67846db for instance 32d87977-fb85-4de5-96a8-e3b1cf8be517 on hv-cinder-81571 May 26 12:58:38.563542 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [req-9ff5b4f3-3527-47dc-9880-3728d7991e65 req-d1afdd8c-c90d-4270-8f91-31d4f08a8b63 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045577 May 26 12:58:38.564409 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 529/1053] 10.222.0.41 () {64 vars in 1317 bytes} [Thu May 26 12:58:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 12:58:39.183083 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-e78ca728-0fea-43a8-b9be-76cfbf3f5d8e tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:58:39.184312 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-e78ca728-0fea-43a8-b9be-76cfbf3f5d8e tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] [instance: 32d87977-fb85-4de5-96a8-e3b1cf8be517] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:58:39.191588 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG dbcounter [-] [124823] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=124823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:58:39.193601 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-e78ca728-0fea-43a8-b9be-76cfbf3f5d8e tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:58:39.194316 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-e78ca728-0fea-43a8-b9be-76cfbf3f5d8e tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:58:39.195897 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-e78ca728-0fea-43a8-b9be-76cfbf3f5d8e tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:58:39.196968 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-e78ca728-0fea-43a8-b9be-76cfbf3f5d8e tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:58:39.234942 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-e78ca728-0fea-43a8-b9be-76cfbf3f5d8e tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:58:39.235468 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-e78ca728-0fea-43a8-b9be-76cfbf3f5d8e tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:58:39.236186 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.objects.instance [None req-e78ca728-0fea-43a8-b9be-76cfbf3f5d8e tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lazy-loading 'fault' on Instance uuid 32d87977-fb85-4de5-96a8-e3b1cf8be517 {{(pid=124823) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:58:39.287185 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-e78ca728-0fea-43a8-b9be-76cfbf3f5d8e tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa52505a079041efbbf14fb04da7ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe580a28eae4195be1491ac29d373a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:58:39.294859 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-e78ca728-0fea-43a8-b9be-76cfbf3f5d8e tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] 10.222.0.41 "GET /compute/v2.1/servers/32d87977-fb85-4de5-96a8-e3b1cf8be517" status: 200 len: 1328 microversion: 2.1 time: 0.117096 May 26 12:58:39.295439 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 525/1054] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:58:39 2022] GET /compute/v2.1/servers/32d87977-fb85-4de5-96a8-e3b1cf8be517 => generated 1328 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:58:40.316332 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-8da39884-4ffa-4a1d-8a27-64feb2089683 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:58:40.317036 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-8da39884-4ffa-4a1d-8a27-64feb2089683 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] [instance: 32d87977-fb85-4de5-96a8-e3b1cf8be517] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:58:40.319038 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG dbcounter [-] [124824] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=124824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:58:40.324015 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-8da39884-4ffa-4a1d-8a27-64feb2089683 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:58:40.324474 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-8da39884-4ffa-4a1d-8a27-64feb2089683 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:58:40.325244 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-8da39884-4ffa-4a1d-8a27-64feb2089683 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:58:40.326185 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-8da39884-4ffa-4a1d-8a27-64feb2089683 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:58:40.341928 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.wsgi [None req-8da39884-4ffa-4a1d-8a27-64feb2089683 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] HTTP exception thrown: Instance 32d87977-fb85-4de5-96a8-e3b1cf8be517 could not be found. May 26 12:58:40.343921 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-8da39884-4ffa-4a1d-8a27-64feb2089683 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Request method failure captured: May 26 12:58:40.343921 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: request: GET /compute/v2.1/servers/32d87977-fb85-4de5-96a8-e3b1cf8be517 HTTP/1.1 May 26 12:58:40.343921 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Accept: application/json May 26 12:58:40.343921 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Accept-Encoding: identity May 26 12:58:40.343921 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Connection: close May 26 12:58:40.343921 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Content-Length: 0 May 26 12:58:40.343921 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Content-Type: application/json May 26 12:58:40.343921 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Host: 10.222.0.41 May 26 12:58:40.343921 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Openstack-System-Scope: None May 26 12:58:40.343921 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: User-Agent: python-urllib3/1.26.9 May 26 12:58:40.343921 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Auth-Token: gAAAAABij3hkrszXMbOxGaO0XC_ch2m84PydcTKd9ChbDbnHV1NkHyaXMEiNHJHT6esADyyvwy4QNE8tfFZ3dOAN16gUWgyhAuN4rVtWXd5wBHq5BqNnGR1jPm-Js-9omuJGjT4CaP-ieNU8WlTkh0eqwkFYqQ4hEofYMLp5W-UNJRESs7gbWiU May 26 12:58:40.343921 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Domain-Id: None May 26 12:58:40.343921 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Domain-Name: None May 26 12:58:40.343921 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Identity-Status: Confirmed May 26 12:58:40.343921 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Is-Admin-Project: True May 26 12:58:40.343921 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Domain-Id: default May 26 12:58:40.343921 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Domain-Name: Default May 26 12:58:40.343921 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Id: cbe580a28eae4195be1491ac29d373a7 May 26 12:58:40.343921 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Name: tempest-AttachVolumeTestJSON-494224153 May 26 12:58:40.343921 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Role: member,reader May 26 12:58:40.343921 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Roles: member,reader May 26 12:58:40.345558 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/cbe580a28eae4195be1491ac29d373a7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/cbe580a28eae4195be1491ac29d373a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/cbe580a28eae4195be1491ac29d373a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_cbe580a28eae4195be1491ac29d373a7", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 26 12:58:40.345558 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Tenant: tempest-AttachVolumeTestJSON-494224153 May 26 12:58:40.345558 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Tenant-Id: cbe580a28eae4195be1491ac29d373a7 May 26 12:58:40.345558 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Tenant-Name: tempest-AttachVolumeTestJSON-494224153 May 26 12:58:40.345558 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User: tempest-AttachVolumeTestJSON-494224153-project May 26 12:58:40.345558 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Domain-Id: default May 26 12:58:40.345558 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Domain-Name: Default May 26 12:58:40.345558 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Id: aa52505a079041efbbf14fb04da7ac7f May 26 12:58:40.345558 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Name: tempest-AttachVolumeTestJSON-494224153-project May 26 12:58:40.345558 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: method: > May 26 12:58:40.345558 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: exception: Instance 32d87977-fb85-4de5-96a8-e3b1cf8be517 could not be found. May 26 12:58:40.345558 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: action_args: {'id': '32d87977-fb85-4de5-96a8-e3b1cf8be517'} May 26 12:58:40.346481 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:58:40.346481 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:58:40.346481 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:58:40.346481 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:58:40.346481 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:58:40.346481 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:58:40.346481 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:58:40.346481 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:58:40.346481 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:58:40.346481 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:58:40.346481 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32d87977-fb85-4de5-96a8-e3b1cf8be517 could not be found. May 26 12:58:40.346481 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:58:40.346481 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:58:40.346481 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:58:40.346481 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:58:40.346481 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:58:40.346481 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:58:40.346481 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:58:40.346481 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:58:40.346481 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:58:40.347730 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:58:40.347730 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 12:58:40.347730 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 12:58:40.347730 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:58:40.347730 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:58:40.347730 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:58:40.347730 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:58:40.347730 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32d87977-fb85-4de5-96a8-e3b1cf8be517 could not be found. May 26 12:58:40.347730 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:58:40.347730 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:58:40.347730 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:58:40.347730 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:58:40.347730 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:58:40.347730 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:58:40.347730 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:58:40.347730 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:58:40.347730 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32d87977-fb85-4de5-96a8-e3b1cf8be517 could not be found. May 26 12:58:40.347730 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:58:40.348863 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-8da39884-4ffa-4a1d-8a27-64feb2089683 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Returning 404 to user: Instance 32d87977-fb85-4de5-96a8-e3b1cf8be517 could not be found. {{(pid=124824) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:58:40.348863 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-8da39884-4ffa-4a1d-8a27-64feb2089683 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] 10.222.0.41 "GET /compute/v2.1/servers/32d87977-fb85-4de5-96a8-e3b1cf8be517" status: 404 len: 111 microversion: 2.1 time: 0.033865 May 26 12:58:40.348863 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 530/1055] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:58:40 2022] GET /compute/v2.1/servers/32d87977-fb85-4de5-96a8-e3b1cf8be517 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:58:40.355626 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-4309e425-c98c-41e9-8962-3fe2b6922119 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Calling method '.version_select at 0x7f26a3c72550>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:58:40.421040 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-4309e425-c98c-41e9-8962-3fe2b6922119 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1778190042" status: 202 len: 0 microversion: 2.1 time: 0.070286 May 26 12:58:40.421632 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 526/1056] 10.222.0.41 () {58 vars in 1220 bytes} [Thu May 26 12:58:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1778190042 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 12:58:44.032906 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-aa55657c-6ca6-407b-8f1c-3e5565a580dd tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:58:44.033455 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-aa55657c-6ca6-407b-8f1c-3e5565a580dd tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] [instance: 32d87977-fb85-4de5-96a8-e3b1cf8be517] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:58:44.041290 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-aa55657c-6ca6-407b-8f1c-3e5565a580dd tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:58:44.041698 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-aa55657c-6ca6-407b-8f1c-3e5565a580dd tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:58:44.042583 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-aa55657c-6ca6-407b-8f1c-3e5565a580dd tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:58:44.043014 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-aa55657c-6ca6-407b-8f1c-3e5565a580dd tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:58:44.056986 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.wsgi [None req-aa55657c-6ca6-407b-8f1c-3e5565a580dd tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] HTTP exception thrown: Instance 32d87977-fb85-4de5-96a8-e3b1cf8be517 could not be found. May 26 12:58:44.058795 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-aa55657c-6ca6-407b-8f1c-3e5565a580dd tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Request method failure captured: May 26 12:58:44.058795 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: request: DELETE /compute/v2.1/servers/32d87977-fb85-4de5-96a8-e3b1cf8be517 HTTP/1.1 May 26 12:58:44.058795 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Accept: application/json May 26 12:58:44.058795 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Accept-Encoding: identity May 26 12:58:44.058795 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Connection: close May 26 12:58:44.058795 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Content-Length: 0 May 26 12:58:44.058795 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Content-Type: application/json May 26 12:58:44.058795 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Host: 10.222.0.41 May 26 12:58:44.058795 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Openstack-System-Scope: None May 26 12:58:44.058795 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: User-Agent: python-urllib3/1.26.9 May 26 12:58:44.058795 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Auth-Token: gAAAAABij3hkrszXMbOxGaO0XC_ch2m84PydcTKd9ChbDbnHV1NkHyaXMEiNHJHT6esADyyvwy4QNE8tfFZ3dOAN16gUWgyhAuN4rVtWXd5wBHq5BqNnGR1jPm-Js-9omuJGjT4CaP-ieNU8WlTkh0eqwkFYqQ4hEofYMLp5W-UNJRESs7gbWiU May 26 12:58:44.058795 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Domain-Id: None May 26 12:58:44.058795 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Domain-Name: None May 26 12:58:44.058795 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Identity-Status: Confirmed May 26 12:58:44.058795 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Is-Admin-Project: True May 26 12:58:44.058795 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Domain-Id: default May 26 12:58:44.058795 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Domain-Name: Default May 26 12:58:44.058795 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Id: cbe580a28eae4195be1491ac29d373a7 May 26 12:58:44.058795 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Name: tempest-AttachVolumeTestJSON-494224153 May 26 12:58:44.058795 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Role: member,reader May 26 12:58:44.058795 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Roles: member,reader May 26 12:58:44.060466 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/cbe580a28eae4195be1491ac29d373a7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/cbe580a28eae4195be1491ac29d373a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/cbe580a28eae4195be1491ac29d373a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_cbe580a28eae4195be1491ac29d373a7", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 26 12:58:44.060466 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Tenant: tempest-AttachVolumeTestJSON-494224153 May 26 12:58:44.060466 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Tenant-Id: cbe580a28eae4195be1491ac29d373a7 May 26 12:58:44.060466 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Tenant-Name: tempest-AttachVolumeTestJSON-494224153 May 26 12:58:44.060466 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User: tempest-AttachVolumeTestJSON-494224153-project May 26 12:58:44.060466 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Domain-Id: default May 26 12:58:44.060466 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Domain-Name: Default May 26 12:58:44.060466 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Id: aa52505a079041efbbf14fb04da7ac7f May 26 12:58:44.060466 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Name: tempest-AttachVolumeTestJSON-494224153-project May 26 12:58:44.060466 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: method: > May 26 12:58:44.060466 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: exception: Instance 32d87977-fb85-4de5-96a8-e3b1cf8be517 could not be found. May 26 12:58:44.060466 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: action_args: {'id': '32d87977-fb85-4de5-96a8-e3b1cf8be517'} May 26 12:58:44.061598 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:58:44.061598 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:58:44.061598 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:58:44.061598 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:58:44.061598 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:58:44.061598 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:58:44.061598 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:58:44.061598 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:58:44.061598 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:58:44.061598 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:58:44.061598 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32d87977-fb85-4de5-96a8-e3b1cf8be517 could not be found. May 26 12:58:44.061598 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:58:44.061598 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:58:44.061598 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:58:44.061598 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:58:44.061598 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:58:44.061598 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:58:44.061598 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:58:44.061598 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:58:44.061598 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:58:44.063119 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:58:44.063119 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 12:58:44.063119 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 12:58:44.063119 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 12:58:44.063119 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 12:58:44.063119 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:58:44.063119 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:58:44.063119 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:58:44.063119 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:58:44.063119 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32d87977-fb85-4de5-96a8-e3b1cf8be517 could not be found. May 26 12:58:44.063119 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:58:44.063119 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:58:44.063119 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:58:44.063119 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:58:44.063119 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:58:44.063119 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:58:44.063119 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:58:44.063119 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:58:44.063119 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32d87977-fb85-4de5-96a8-e3b1cf8be517 could not be found. May 26 12:58:44.063119 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:58:44.064534 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-aa55657c-6ca6-407b-8f1c-3e5565a580dd tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Returning 404 to user: Instance 32d87977-fb85-4de5-96a8-e3b1cf8be517 could not be found. {{(pid=124824) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:58:44.064534 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-aa55657c-6ca6-407b-8f1c-3e5565a580dd tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] 10.222.0.41 "DELETE /compute/v2.1/servers/32d87977-fb85-4de5-96a8-e3b1cf8be517" status: 404 len: 111 microversion: 2.1 time: 0.031126 May 26 12:58:44.064534 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 531/1057] 10.222.0.41 () {58 vars in 1238 bytes} [Thu May 26 12:58:44 2022] DELETE /compute/v2.1/servers/32d87977-fb85-4de5-96a8-e3b1cf8be517 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:58:44.069888 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-de3669db-bd0f-4f6b-a706-6c73e7ab03b8 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:58:44.070528 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-de3669db-bd0f-4f6b-a706-6c73e7ab03b8 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] [instance: 32d87977-fb85-4de5-96a8-e3b1cf8be517] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:58:44.076959 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-de3669db-bd0f-4f6b-a706-6c73e7ab03b8 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:58:44.077823 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-de3669db-bd0f-4f6b-a706-6c73e7ab03b8 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:58:44.078178 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-de3669db-bd0f-4f6b-a706-6c73e7ab03b8 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:58:44.078614 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-de3669db-bd0f-4f6b-a706-6c73e7ab03b8 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:58:44.093829 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.wsgi [None req-de3669db-bd0f-4f6b-a706-6c73e7ab03b8 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] HTTP exception thrown: Instance 32d87977-fb85-4de5-96a8-e3b1cf8be517 could not be found. May 26 12:58:44.095459 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-de3669db-bd0f-4f6b-a706-6c73e7ab03b8 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Request method failure captured: May 26 12:58:44.095459 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: request: GET /compute/v2.1/servers/32d87977-fb85-4de5-96a8-e3b1cf8be517 HTTP/1.1 May 26 12:58:44.095459 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Accept: application/json May 26 12:58:44.095459 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Accept-Encoding: identity May 26 12:58:44.095459 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Connection: close May 26 12:58:44.095459 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Content-Length: 0 May 26 12:58:44.095459 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Content-Type: application/json May 26 12:58:44.095459 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Host: 10.222.0.41 May 26 12:58:44.095459 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Openstack-System-Scope: None May 26 12:58:44.095459 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: User-Agent: python-urllib3/1.26.9 May 26 12:58:44.095459 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Auth-Token: gAAAAABij3hkrszXMbOxGaO0XC_ch2m84PydcTKd9ChbDbnHV1NkHyaXMEiNHJHT6esADyyvwy4QNE8tfFZ3dOAN16gUWgyhAuN4rVtWXd5wBHq5BqNnGR1jPm-Js-9omuJGjT4CaP-ieNU8WlTkh0eqwkFYqQ4hEofYMLp5W-UNJRESs7gbWiU May 26 12:58:44.095459 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Domain-Id: None May 26 12:58:44.095459 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Domain-Name: None May 26 12:58:44.095459 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Identity-Status: Confirmed May 26 12:58:44.095459 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Is-Admin-Project: True May 26 12:58:44.095459 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Project-Domain-Id: default May 26 12:58:44.095459 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Project-Domain-Name: Default May 26 12:58:44.095459 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Project-Id: cbe580a28eae4195be1491ac29d373a7 May 26 12:58:44.095459 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Project-Name: tempest-AttachVolumeTestJSON-494224153 May 26 12:58:44.095459 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Role: member,reader May 26 12:58:44.095459 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Roles: member,reader May 26 12:58:44.097018 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/cbe580a28eae4195be1491ac29d373a7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/cbe580a28eae4195be1491ac29d373a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/cbe580a28eae4195be1491ac29d373a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_cbe580a28eae4195be1491ac29d373a7", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 26 12:58:44.097018 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Tenant: tempest-AttachVolumeTestJSON-494224153 May 26 12:58:44.097018 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Tenant-Id: cbe580a28eae4195be1491ac29d373a7 May 26 12:58:44.097018 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Tenant-Name: tempest-AttachVolumeTestJSON-494224153 May 26 12:58:44.097018 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User: tempest-AttachVolumeTestJSON-494224153-project May 26 12:58:44.097018 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User-Domain-Id: default May 26 12:58:44.097018 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User-Domain-Name: Default May 26 12:58:44.097018 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User-Id: aa52505a079041efbbf14fb04da7ac7f May 26 12:58:44.097018 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User-Name: tempest-AttachVolumeTestJSON-494224153-project May 26 12:58:44.097018 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: method: > May 26 12:58:44.097018 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: exception: Instance 32d87977-fb85-4de5-96a8-e3b1cf8be517 could not be found. May 26 12:58:44.097018 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: action_args: {'id': '32d87977-fb85-4de5-96a8-e3b1cf8be517'} May 26 12:58:44.097887 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:58:44.097887 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:58:44.097887 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:58:44.097887 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:58:44.097887 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:58:44.097887 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:58:44.097887 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:58:44.097887 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:58:44.097887 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:58:44.097887 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:58:44.097887 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32d87977-fb85-4de5-96a8-e3b1cf8be517 could not be found. May 26 12:58:44.097887 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:58:44.097887 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:58:44.097887 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:58:44.097887 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:58:44.097887 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:58:44.097887 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:58:44.097887 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:58:44.097887 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:58:44.097887 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:58:44.099133 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:58:44.099133 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 12:58:44.099133 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 12:58:44.099133 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:58:44.099133 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:58:44.099133 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:58:44.099133 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:58:44.099133 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32d87977-fb85-4de5-96a8-e3b1cf8be517 could not be found. May 26 12:58:44.099133 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:58:44.099133 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:58:44.099133 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:58:44.099133 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:58:44.099133 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:58:44.099133 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:58:44.099133 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:58:44.099133 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:58:44.099133 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32d87977-fb85-4de5-96a8-e3b1cf8be517 could not be found. May 26 12:58:44.099133 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:58:44.100240 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-de3669db-bd0f-4f6b-a706-6c73e7ab03b8 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Returning 404 to user: Instance 32d87977-fb85-4de5-96a8-e3b1cf8be517 could not be found. {{(pid=124823) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:58:44.100240 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-de3669db-bd0f-4f6b-a706-6c73e7ab03b8 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] 10.222.0.41 "GET /compute/v2.1/servers/32d87977-fb85-4de5-96a8-e3b1cf8be517" status: 404 len: 111 microversion: 2.1 time: 0.032083 May 26 12:58:44.100240 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 527/1058] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:58:44 2022] GET /compute/v2.1/servers/32d87977-fb85-4de5-96a8-e3b1cf8be517 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:58:45.398897 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-fbf1f411-fb5f-49db-8d21-ec555e27c702 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:58:45.399440 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-fbf1f411-fb5f-49db-8d21-ec555e27c702 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] [instance: 7f3fde81-3f47-4590-ad2e-330bd31ed1f7] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:58:45.407402 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-fbf1f411-fb5f-49db-8d21-ec555e27c702 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:58:45.407852 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-fbf1f411-fb5f-49db-8d21-ec555e27c702 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:58:45.408638 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-fbf1f411-fb5f-49db-8d21-ec555e27c702 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:58:45.409076 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-fbf1f411-fb5f-49db-8d21-ec555e27c702 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:58:45.424504 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.wsgi [None req-fbf1f411-fb5f-49db-8d21-ec555e27c702 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] HTTP exception thrown: Instance 7f3fde81-3f47-4590-ad2e-330bd31ed1f7 could not be found. May 26 12:58:45.426043 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-fbf1f411-fb5f-49db-8d21-ec555e27c702 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Request method failure captured: May 26 12:58:45.426043 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: request: DELETE /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7 HTTP/1.1 May 26 12:58:45.426043 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Accept: application/json May 26 12:58:45.426043 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Accept-Encoding: identity May 26 12:58:45.426043 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Connection: close May 26 12:58:45.426043 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Content-Length: 0 May 26 12:58:45.426043 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Content-Type: application/json May 26 12:58:45.426043 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Host: 10.222.0.41 May 26 12:58:45.426043 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Openstack-System-Scope: None May 26 12:58:45.426043 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: User-Agent: python-urllib3/1.26.9 May 26 12:58:45.426043 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Auth-Token: gAAAAABij3hkrszXMbOxGaO0XC_ch2m84PydcTKd9ChbDbnHV1NkHyaXMEiNHJHT6esADyyvwy4QNE8tfFZ3dOAN16gUWgyhAuN4rVtWXd5wBHq5BqNnGR1jPm-Js-9omuJGjT4CaP-ieNU8WlTkh0eqwkFYqQ4hEofYMLp5W-UNJRESs7gbWiU May 26 12:58:45.426043 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Domain-Id: None May 26 12:58:45.426043 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Domain-Name: None May 26 12:58:45.426043 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Identity-Status: Confirmed May 26 12:58:45.426043 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Is-Admin-Project: True May 26 12:58:45.426043 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Domain-Id: default May 26 12:58:45.426043 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Domain-Name: Default May 26 12:58:45.426043 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Id: cbe580a28eae4195be1491ac29d373a7 May 26 12:58:45.426043 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Name: tempest-AttachVolumeTestJSON-494224153 May 26 12:58:45.426043 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Role: member,reader May 26 12:58:45.426043 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Roles: member,reader May 26 12:58:45.427623 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/cbe580a28eae4195be1491ac29d373a7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/cbe580a28eae4195be1491ac29d373a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/cbe580a28eae4195be1491ac29d373a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_cbe580a28eae4195be1491ac29d373a7", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 26 12:58:45.427623 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Tenant: tempest-AttachVolumeTestJSON-494224153 May 26 12:58:45.427623 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Tenant-Id: cbe580a28eae4195be1491ac29d373a7 May 26 12:58:45.427623 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Tenant-Name: tempest-AttachVolumeTestJSON-494224153 May 26 12:58:45.427623 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User: tempest-AttachVolumeTestJSON-494224153-project May 26 12:58:45.427623 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Domain-Id: default May 26 12:58:45.427623 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Domain-Name: Default May 26 12:58:45.427623 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Id: aa52505a079041efbbf14fb04da7ac7f May 26 12:58:45.427623 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Name: tempest-AttachVolumeTestJSON-494224153-project May 26 12:58:45.427623 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: method: > May 26 12:58:45.427623 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: exception: Instance 7f3fde81-3f47-4590-ad2e-330bd31ed1f7 could not be found. May 26 12:58:45.427623 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: action_args: {'id': '7f3fde81-3f47-4590-ad2e-330bd31ed1f7'} May 26 12:58:45.428524 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:58:45.428524 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:58:45.428524 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:58:45.428524 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:58:45.428524 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:58:45.428524 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:58:45.428524 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:58:45.428524 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:58:45.428524 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:58:45.428524 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:58:45.428524 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f3fde81-3f47-4590-ad2e-330bd31ed1f7 could not be found. May 26 12:58:45.428524 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:58:45.428524 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:58:45.428524 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:58:45.428524 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:58:45.428524 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:58:45.428524 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:58:45.428524 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:58:45.428524 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:58:45.428524 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:58:45.430637 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:58:45.430637 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 12:58:45.430637 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 12:58:45.430637 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 12:58:45.430637 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 12:58:45.430637 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:58:45.430637 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:58:45.430637 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:58:45.430637 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:58:45.430637 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f3fde81-3f47-4590-ad2e-330bd31ed1f7 could not be found. May 26 12:58:45.430637 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:58:45.430637 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:58:45.430637 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:58:45.430637 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:58:45.430637 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:58:45.430637 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:58:45.430637 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:58:45.430637 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:58:45.430637 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f3fde81-3f47-4590-ad2e-330bd31ed1f7 could not be found. May 26 12:58:45.430637 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 12:58:45.432075 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-fbf1f411-fb5f-49db-8d21-ec555e27c702 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Returning 404 to user: Instance 7f3fde81-3f47-4590-ad2e-330bd31ed1f7 could not be found. {{(pid=124824) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:58:45.432075 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-fbf1f411-fb5f-49db-8d21-ec555e27c702 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] 10.222.0.41 "DELETE /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7" status: 404 len: 111 microversion: 2.1 time: 0.032452 May 26 12:58:45.432075 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 532/1059] 10.222.0.41 () {58 vars in 1238 bytes} [Thu May 26 12:58:45 2022] DELETE /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:58:45.437074 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-8a743f9e-1223-4f82-bf7d-aefa7072c468 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:58:45.437751 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-8a743f9e-1223-4f82-bf7d-aefa7072c468 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] [instance: 7f3fde81-3f47-4590-ad2e-330bd31ed1f7] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:58:45.444852 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-8a743f9e-1223-4f82-bf7d-aefa7072c468 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:58:45.445898 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-8a743f9e-1223-4f82-bf7d-aefa7072c468 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:58:45.446694 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-8a743f9e-1223-4f82-bf7d-aefa7072c468 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:58:45.447135 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-8a743f9e-1223-4f82-bf7d-aefa7072c468 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:58:45.462025 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.wsgi [None req-8a743f9e-1223-4f82-bf7d-aefa7072c468 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] HTTP exception thrown: Instance 7f3fde81-3f47-4590-ad2e-330bd31ed1f7 could not be found. May 26 12:58:45.463627 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-8a743f9e-1223-4f82-bf7d-aefa7072c468 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Request method failure captured: May 26 12:58:45.463627 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: request: GET /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7 HTTP/1.1 May 26 12:58:45.463627 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Accept: application/json May 26 12:58:45.463627 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Accept-Encoding: identity May 26 12:58:45.463627 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Connection: close May 26 12:58:45.463627 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Content-Length: 0 May 26 12:58:45.463627 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Content-Type: application/json May 26 12:58:45.463627 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Host: 10.222.0.41 May 26 12:58:45.463627 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Openstack-System-Scope: None May 26 12:58:45.463627 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: User-Agent: python-urllib3/1.26.9 May 26 12:58:45.463627 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Auth-Token: gAAAAABij3hkrszXMbOxGaO0XC_ch2m84PydcTKd9ChbDbnHV1NkHyaXMEiNHJHT6esADyyvwy4QNE8tfFZ3dOAN16gUWgyhAuN4rVtWXd5wBHq5BqNnGR1jPm-Js-9omuJGjT4CaP-ieNU8WlTkh0eqwkFYqQ4hEofYMLp5W-UNJRESs7gbWiU May 26 12:58:45.463627 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Domain-Id: None May 26 12:58:45.463627 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Domain-Name: None May 26 12:58:45.463627 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Identity-Status: Confirmed May 26 12:58:45.463627 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Is-Admin-Project: True May 26 12:58:45.463627 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Project-Domain-Id: default May 26 12:58:45.463627 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Project-Domain-Name: Default May 26 12:58:45.463627 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Project-Id: cbe580a28eae4195be1491ac29d373a7 May 26 12:58:45.463627 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Project-Name: tempest-AttachVolumeTestJSON-494224153 May 26 12:58:45.463627 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Role: member,reader May 26 12:58:45.463627 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Roles: member,reader May 26 12:58:45.465356 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/cbe580a28eae4195be1491ac29d373a7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/cbe580a28eae4195be1491ac29d373a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/cbe580a28eae4195be1491ac29d373a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_cbe580a28eae4195be1491ac29d373a7", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 26 12:58:45.465356 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Tenant: tempest-AttachVolumeTestJSON-494224153 May 26 12:58:45.465356 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Tenant-Id: cbe580a28eae4195be1491ac29d373a7 May 26 12:58:45.465356 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-Tenant-Name: tempest-AttachVolumeTestJSON-494224153 May 26 12:58:45.465356 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User: tempest-AttachVolumeTestJSON-494224153-project May 26 12:58:45.465356 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User-Domain-Id: default May 26 12:58:45.465356 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User-Domain-Name: Default May 26 12:58:45.465356 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User-Id: aa52505a079041efbbf14fb04da7ac7f May 26 12:58:45.465356 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: X-User-Name: tempest-AttachVolumeTestJSON-494224153-project May 26 12:58:45.465356 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: method: > May 26 12:58:45.465356 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: exception: Instance 7f3fde81-3f47-4590-ad2e-330bd31ed1f7 could not be found. May 26 12:58:45.465356 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: action_args: {'id': '7f3fde81-3f47-4590-ad2e-330bd31ed1f7'} May 26 12:58:45.466507 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 12:58:45.466507 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:58:45.466507 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 12:58:45.466507 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 12:58:45.466507 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 12:58:45.466507 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 12:58:45.466507 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 12:58:45.466507 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 12:58:45.466507 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 12:58:45.466507 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 12:58:45.466507 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f3fde81-3f47-4590-ad2e-330bd31ed1f7 could not be found. May 26 12:58:45.466507 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:58:45.466507 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:58:45.466507 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:58:45.466507 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:58:45.466507 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:58:45.466507 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:58:45.466507 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 12:58:45.466507 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 12:58:45.466507 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 12:58:45.467739 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 12:58:45.467739 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 12:58:45.467739 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 12:58:45.467739 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 12:58:45.467739 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 12:58:45.467739 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 12:58:45.467739 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 12:58:45.467739 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f3fde81-3f47-4590-ad2e-330bd31ed1f7 could not be found. May 26 12:58:45.467739 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:58:45.467739 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 12:58:45.467739 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:58:45.467739 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 12:58:45.467739 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 12:58:45.467739 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 12:58:45.467739 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 12:58:45.467739 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 12:58:45.467739 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f3fde81-3f47-4590-ad2e-330bd31ed1f7 could not be found. May 26 12:58:45.467739 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: ERROR nova.api.openstack.wsgi May 26 12:58:45.468872 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-8a743f9e-1223-4f82-bf7d-aefa7072c468 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] Returning 404 to user: Instance 7f3fde81-3f47-4590-ad2e-330bd31ed1f7 could not be found. {{(pid=124823) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 12:58:45.468872 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-8a743f9e-1223-4f82-bf7d-aefa7072c468 tempest-AttachVolumeTestJSON-494224153 tempest-AttachVolumeTestJSON-494224153-project] 10.222.0.41 "GET /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7" status: 404 len: 111 microversion: 2.1 time: 0.032029 May 26 12:58:45.468872 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 528/1060] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:58:45 2022] GET /compute/v2.1/servers/7f3fde81-3f47-4590-ad2e-330bd31ed1f7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 12:59:15.718235 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-1ff7e92b-6308-4f04-85ab-94620fcaa3e2 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:59:15.718805 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-1ff7e92b-6308-4f04-85ab-94620fcaa3e2 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] [instance: d3e49793-145c-4fea-979c-3875adb1ef35] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:59:15.721175 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG dbcounter [-] [124824] Writing DB stats nova_cell1:SELECT=15,nova_cell1:INSERT=1 {{(pid=124824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:59:15.725966 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-1ff7e92b-6308-4f04-85ab-94620fcaa3e2 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:15.726411 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-1ff7e92b-6308-4f04-85ab-94620fcaa3e2 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:15.727170 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-1ff7e92b-6308-4f04-85ab-94620fcaa3e2 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:15.727603 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-1ff7e92b-6308-4f04-85ab-94620fcaa3e2 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:15.750235 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.objects.instance [None req-1ff7e92b-6308-4f04-85ab-94620fcaa3e2 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lazy-loading 'flavor' on Instance uuid d3e49793-145c-4fea-979c-3875adb1ef35 {{(pid=124824) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 12:59:16.004794 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-1ff7e92b-6308-4f04-85ab-94620fcaa3e2 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] 10.222.0.41 "POST /compute/v2.1/servers/d3e49793-145c-4fea-979c-3875adb1ef35/action" status: 202 len: 0 microversion: 2.1 time: 0.290505 May 26 12:59:16.005390 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 533/1061] 10.222.0.41 () {60 vars in 1277 bytes} [Thu May 26 12:59:15 2022] POST /compute/v2.1/servers/d3e49793-145c-4fea-979c-3875adb1ef35/action => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 12:59:16.014648 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-ac52277f-f7fb-4de5-8dc5-4f3cf01a7a08 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:59:16.015756 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-ac52277f-f7fb-4de5-8dc5-4f3cf01a7a08 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] [instance: d3e49793-145c-4fea-979c-3875adb1ef35] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:59:16.019129 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG dbcounter [-] [124823] Writing DB stats nova_api:SELECT=10,nova_api:DELETE=1 {{(pid=124823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:59:16.019813 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG dbcounter [-] [124823] Writing DB stats nova_cell1:SELECT=27 {{(pid=124823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:59:16.025435 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-ac52277f-f7fb-4de5-8dc5-4f3cf01a7a08 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:16.025918 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-ac52277f-f7fb-4de5-8dc5-4f3cf01a7a08 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:16.026701 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-ac52277f-f7fb-4de5-8dc5-4f3cf01a7a08 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:16.027138 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-ac52277f-f7fb-4de5-8dc5-4f3cf01a7a08 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:16.163796 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-ac52277f-f7fb-4de5-8dc5-4f3cf01a7a08 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03ca4f264eb42ddbe92f5cb95d9fc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2ea80ac0374c2c870a494adc6534ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:59:16.171859 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-ac52277f-f7fb-4de5-8dc5-4f3cf01a7a08 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] 10.222.0.41 "GET /compute/v2.1/servers/d3e49793-145c-4fea-979c-3875adb1ef35" status: 200 len: 1567 microversion: 2.1 time: 0.161148 May 26 12:59:16.172420 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 529/1062] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:59:16 2022] GET /compute/v2.1/servers/d3e49793-145c-4fea-979c-3875adb1ef35 => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:59:17.190605 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-ba5cc5f2-5bc8-4ccf-873d-0639b1a002b8 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:59:17.191303 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-ba5cc5f2-5bc8-4ccf-873d-0639b1a002b8 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] [instance: d3e49793-145c-4fea-979c-3875adb1ef35] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:59:17.197880 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-ba5cc5f2-5bc8-4ccf-873d-0639b1a002b8 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:17.198327 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-ba5cc5f2-5bc8-4ccf-873d-0639b1a002b8 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:17.199086 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-ba5cc5f2-5bc8-4ccf-873d-0639b1a002b8 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:17.199517 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-ba5cc5f2-5bc8-4ccf-873d-0639b1a002b8 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:17.333086 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-ba5cc5f2-5bc8-4ccf-873d-0639b1a002b8 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03ca4f264eb42ddbe92f5cb95d9fc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2ea80ac0374c2c870a494adc6534ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:59:17.341419 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-ba5cc5f2-5bc8-4ccf-873d-0639b1a002b8 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] 10.222.0.41 "GET /compute/v2.1/servers/d3e49793-145c-4fea-979c-3875adb1ef35" status: 200 len: 1567 microversion: 2.1 time: 0.155676 May 26 12:59:17.342109 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 534/1063] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:59:17 2022] GET /compute/v2.1/servers/d3e49793-145c-4fea-979c-3875adb1ef35 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:59:18.359064 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-ca5c0eef-52df-4dcd-b207-db21567f5be9 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:59:18.359718 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-ca5c0eef-52df-4dcd-b207-db21567f5be9 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] [instance: d3e49793-145c-4fea-979c-3875adb1ef35] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:59:18.367347 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-ca5c0eef-52df-4dcd-b207-db21567f5be9 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:18.371201 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-ca5c0eef-52df-4dcd-b207-db21567f5be9 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:18.371201 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-ca5c0eef-52df-4dcd-b207-db21567f5be9 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:18.371201 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-ca5c0eef-52df-4dcd-b207-db21567f5be9 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:18.504860 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-ca5c0eef-52df-4dcd-b207-db21567f5be9 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03ca4f264eb42ddbe92f5cb95d9fc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2ea80ac0374c2c870a494adc6534ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:59:18.514956 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-ca5c0eef-52df-4dcd-b207-db21567f5be9 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] 10.222.0.41 "GET /compute/v2.1/servers/d3e49793-145c-4fea-979c-3875adb1ef35" status: 200 len: 1567 microversion: 2.1 time: 0.159708 May 26 12:59:18.515635 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 530/1064] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:59:18 2022] GET /compute/v2.1/servers/d3e49793-145c-4fea-979c-3875adb1ef35 => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:59:19.532103 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-c6232c36-4ba2-44e8-affe-7e2f7b4fe9b3 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:59:19.532720 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-c6232c36-4ba2-44e8-affe-7e2f7b4fe9b3 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] [instance: d3e49793-145c-4fea-979c-3875adb1ef35] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:59:19.540073 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-c6232c36-4ba2-44e8-affe-7e2f7b4fe9b3 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:19.540502 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-c6232c36-4ba2-44e8-affe-7e2f7b4fe9b3 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:19.541270 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-c6232c36-4ba2-44e8-affe-7e2f7b4fe9b3 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:19.541737 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-c6232c36-4ba2-44e8-affe-7e2f7b4fe9b3 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:19.694721 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-c6232c36-4ba2-44e8-affe-7e2f7b4fe9b3 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03ca4f264eb42ddbe92f5cb95d9fc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2ea80ac0374c2c870a494adc6534ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:59:19.702311 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-c6232c36-4ba2-44e8-affe-7e2f7b4fe9b3 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] 10.222.0.41 "GET /compute/v2.1/servers/d3e49793-145c-4fea-979c-3875adb1ef35" status: 200 len: 1567 microversion: 2.1 time: 0.174064 May 26 12:59:19.702869 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 535/1065] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:59:19 2022] GET /compute/v2.1/servers/d3e49793-145c-4fea-979c-3875adb1ef35 => generated 1567 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:59:20.720254 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-c19c1ab6-0fce-475e-9a66-a0bb7cdf1575 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:59:20.721026 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-c19c1ab6-0fce-475e-9a66-a0bb7cdf1575 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] [instance: d3e49793-145c-4fea-979c-3875adb1ef35] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:59:20.728998 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-c19c1ab6-0fce-475e-9a66-a0bb7cdf1575 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:20.729444 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-c19c1ab6-0fce-475e-9a66-a0bb7cdf1575 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:20.730246 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-c19c1ab6-0fce-475e-9a66-a0bb7cdf1575 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:20.730676 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-c19c1ab6-0fce-475e-9a66-a0bb7cdf1575 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:20.864856 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-c19c1ab6-0fce-475e-9a66-a0bb7cdf1575 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03ca4f264eb42ddbe92f5cb95d9fc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2ea80ac0374c2c870a494adc6534ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:59:20.873317 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-c19c1ab6-0fce-475e-9a66-a0bb7cdf1575 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] 10.222.0.41 "GET /compute/v2.1/servers/d3e49793-145c-4fea-979c-3875adb1ef35" status: 200 len: 1567 microversion: 2.1 time: 0.156924 May 26 12:59:20.873685 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 531/1066] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:59:20 2022] GET /compute/v2.1/servers/d3e49793-145c-4fea-979c-3875adb1ef35 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:59:21.889739 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-aa2666e7-f5da-4102-a8ff-162a2c2598fb tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:59:21.890363 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-aa2666e7-f5da-4102-a8ff-162a2c2598fb tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] [instance: d3e49793-145c-4fea-979c-3875adb1ef35] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:59:21.897771 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-aa2666e7-f5da-4102-a8ff-162a2c2598fb tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:21.898269 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-aa2666e7-f5da-4102-a8ff-162a2c2598fb tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:21.899042 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-aa2666e7-f5da-4102-a8ff-162a2c2598fb tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:21.899484 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-aa2666e7-f5da-4102-a8ff-162a2c2598fb tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:22.030050 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-aa2666e7-f5da-4102-a8ff-162a2c2598fb tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03ca4f264eb42ddbe92f5cb95d9fc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2ea80ac0374c2c870a494adc6534ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:59:22.037629 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-aa2666e7-f5da-4102-a8ff-162a2c2598fb tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] 10.222.0.41 "GET /compute/v2.1/servers/d3e49793-145c-4fea-979c-3875adb1ef35" status: 200 len: 1567 microversion: 2.1 time: 0.151769 May 26 12:59:22.038867 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 536/1067] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:59:21 2022] GET /compute/v2.1/servers/d3e49793-145c-4fea-979c-3875adb1ef35 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:59:23.055914 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-438ccfeb-bc4d-43ce-bdd7-a034f4b86553 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:59:23.056529 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-438ccfeb-bc4d-43ce-bdd7-a034f4b86553 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] [instance: d3e49793-145c-4fea-979c-3875adb1ef35] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:59:23.063240 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-438ccfeb-bc4d-43ce-bdd7-a034f4b86553 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:23.063689 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-438ccfeb-bc4d-43ce-bdd7-a034f4b86553 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:23.064461 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-438ccfeb-bc4d-43ce-bdd7-a034f4b86553 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:23.064898 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-438ccfeb-bc4d-43ce-bdd7-a034f4b86553 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:23.203149 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-438ccfeb-bc4d-43ce-bdd7-a034f4b86553 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03ca4f264eb42ddbe92f5cb95d9fc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2ea80ac0374c2c870a494adc6534ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:59:23.211765 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-438ccfeb-bc4d-43ce-bdd7-a034f4b86553 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] 10.222.0.41 "GET /compute/v2.1/servers/d3e49793-145c-4fea-979c-3875adb1ef35" status: 200 len: 1567 microversion: 2.1 time: 0.160257 May 26 12:59:23.213758 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 532/1068] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:59:23 2022] GET /compute/v2.1/servers/d3e49793-145c-4fea-979c-3875adb1ef35 => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:59:24.228928 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-114b6e32-a55b-4cce-811a-31a11dbf115e tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:59:24.229537 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-114b6e32-a55b-4cce-811a-31a11dbf115e tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] [instance: d3e49793-145c-4fea-979c-3875adb1ef35] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:59:24.236417 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-114b6e32-a55b-4cce-811a-31a11dbf115e tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:24.236863 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-114b6e32-a55b-4cce-811a-31a11dbf115e tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:24.237658 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-114b6e32-a55b-4cce-811a-31a11dbf115e tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:24.238122 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-114b6e32-a55b-4cce-811a-31a11dbf115e tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:24.369785 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-114b6e32-a55b-4cce-811a-31a11dbf115e tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03ca4f264eb42ddbe92f5cb95d9fc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2ea80ac0374c2c870a494adc6534ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:59:24.377654 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-114b6e32-a55b-4cce-811a-31a11dbf115e tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] 10.222.0.41 "GET /compute/v2.1/servers/d3e49793-145c-4fea-979c-3875adb1ef35" status: 200 len: 1567 microversion: 2.1 time: 0.153170 May 26 12:59:24.378267 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 537/1069] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:59:24 2022] GET /compute/v2.1/servers/d3e49793-145c-4fea-979c-3875adb1ef35 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:59:25.395473 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-4b354269-064a-4725-9845-0e1a638ee896 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:59:25.399164 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-4b354269-064a-4725-9845-0e1a638ee896 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] [instance: d3e49793-145c-4fea-979c-3875adb1ef35] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:59:25.402729 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-4b354269-064a-4725-9845-0e1a638ee896 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:25.403530 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-4b354269-064a-4725-9845-0e1a638ee896 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:25.404309 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-4b354269-064a-4725-9845-0e1a638ee896 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:25.404776 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-4b354269-064a-4725-9845-0e1a638ee896 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:25.539385 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-4b354269-064a-4725-9845-0e1a638ee896 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03ca4f264eb42ddbe92f5cb95d9fc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2ea80ac0374c2c870a494adc6534ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:59:25.547830 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-4b354269-064a-4725-9845-0e1a638ee896 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] 10.222.0.41 "GET /compute/v2.1/servers/d3e49793-145c-4fea-979c-3875adb1ef35" status: 200 len: 1567 microversion: 2.1 time: 0.156295 May 26 12:59:25.548406 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 533/1070] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:59:25 2022] GET /compute/v2.1/servers/d3e49793-145c-4fea-979c-3875adb1ef35 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:59:26.565285 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-597f0840-e600-41e5-8e88-d3b941840992 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:59:26.565864 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-597f0840-e600-41e5-8e88-d3b941840992 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] [instance: d3e49793-145c-4fea-979c-3875adb1ef35] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:59:26.573647 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-597f0840-e600-41e5-8e88-d3b941840992 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:26.574112 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-597f0840-e600-41e5-8e88-d3b941840992 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:26.575074 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-597f0840-e600-41e5-8e88-d3b941840992 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:26.575505 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-597f0840-e600-41e5-8e88-d3b941840992 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:26.786736 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-597f0840-e600-41e5-8e88-d3b941840992 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03ca4f264eb42ddbe92f5cb95d9fc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2ea80ac0374c2c870a494adc6534ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:59:26.798412 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-597f0840-e600-41e5-8e88-d3b941840992 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] 10.222.0.41 "GET /compute/v2.1/servers/d3e49793-145c-4fea-979c-3875adb1ef35" status: 200 len: 1567 microversion: 2.1 time: 0.236940 May 26 12:59:26.799606 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 538/1071] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:59:26 2022] GET /compute/v2.1/servers/d3e49793-145c-4fea-979c-3875adb1ef35 => generated 1567 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:59:27.816419 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-2fdbe50e-59e3-4599-8b74-cff9c459f3f2 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:59:27.817015 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-2fdbe50e-59e3-4599-8b74-cff9c459f3f2 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] [instance: d3e49793-145c-4fea-979c-3875adb1ef35] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:59:27.823592 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-2fdbe50e-59e3-4599-8b74-cff9c459f3f2 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:27.824040 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-2fdbe50e-59e3-4599-8b74-cff9c459f3f2 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:27.824797 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-2fdbe50e-59e3-4599-8b74-cff9c459f3f2 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:27.825229 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-2fdbe50e-59e3-4599-8b74-cff9c459f3f2 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:27.956495 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-2fdbe50e-59e3-4599-8b74-cff9c459f3f2 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03ca4f264eb42ddbe92f5cb95d9fc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2ea80ac0374c2c870a494adc6534ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:59:27.964610 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-2fdbe50e-59e3-4599-8b74-cff9c459f3f2 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] 10.222.0.41 "GET /compute/v2.1/servers/d3e49793-145c-4fea-979c-3875adb1ef35" status: 200 len: 1567 microversion: 2.1 time: 0.152099 May 26 12:59:27.965431 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 534/1072] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:59:27 2022] GET /compute/v2.1/servers/d3e49793-145c-4fea-979c-3875adb1ef35 => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:59:27.965606 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 12:59:27.966085 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Thu May 26 12:59:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 12:59:28.987519 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-38c930cd-b5b7-4b33-9198-17062970a2c6 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:59:28.987519 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-38c930cd-b5b7-4b33-9198-17062970a2c6 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] [instance: d3e49793-145c-4fea-979c-3875adb1ef35] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:59:28.990321 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-38c930cd-b5b7-4b33-9198-17062970a2c6 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:28.990809 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-38c930cd-b5b7-4b33-9198-17062970a2c6 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:28.991577 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-38c930cd-b5b7-4b33-9198-17062970a2c6 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:28.992003 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-38c930cd-b5b7-4b33-9198-17062970a2c6 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:29.124680 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-38c930cd-b5b7-4b33-9198-17062970a2c6 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03ca4f264eb42ddbe92f5cb95d9fc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2ea80ac0374c2c870a494adc6534ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:59:29.133073 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-38c930cd-b5b7-4b33-9198-17062970a2c6 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] 10.222.0.41 "GET /compute/v2.1/servers/d3e49793-145c-4fea-979c-3875adb1ef35" status: 200 len: 1567 microversion: 2.1 time: 0.154760 May 26 12:59:29.134819 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 539/1073] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:59:28 2022] GET /compute/v2.1/servers/d3e49793-145c-4fea-979c-3875adb1ef35 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:59:30.150358 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-cb977032-394e-434f-a28a-b4d304bc7427 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:59:30.166671 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-cb977032-394e-434f-a28a-b4d304bc7427 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] [instance: d3e49793-145c-4fea-979c-3875adb1ef35] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:59:30.166671 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-cb977032-394e-434f-a28a-b4d304bc7427 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:30.166671 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-cb977032-394e-434f-a28a-b4d304bc7427 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:30.166671 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-cb977032-394e-434f-a28a-b4d304bc7427 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:30.167094 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-cb977032-394e-434f-a28a-b4d304bc7427 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:30.295820 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-cb977032-394e-434f-a28a-b4d304bc7427 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03ca4f264eb42ddbe92f5cb95d9fc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2ea80ac0374c2c870a494adc6534ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:59:30.303592 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-cb977032-394e-434f-a28a-b4d304bc7427 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] 10.222.0.41 "GET /compute/v2.1/servers/d3e49793-145c-4fea-979c-3875adb1ef35" status: 200 len: 1568 microversion: 2.1 time: 0.157653 May 26 12:59:30.305655 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 535/1074] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:59:30 2022] GET /compute/v2.1/servers/d3e49793-145c-4fea-979c-3875adb1ef35 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:59:30.320063 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-a746a711-4d41-4591-b4aa-d0a92d37433e tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:59:30.320629 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-a746a711-4d41-4591-b4aa-d0a92d37433e tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] [instance: d3e49793-145c-4fea-979c-3875adb1ef35] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:59:30.327162 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-a746a711-4d41-4591-b4aa-d0a92d37433e tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:30.328718 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-a746a711-4d41-4591-b4aa-d0a92d37433e tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:30.328718 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-a746a711-4d41-4591-b4aa-d0a92d37433e tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:30.329026 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-a746a711-4d41-4591-b4aa-d0a92d37433e tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:30.706503 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-a746a711-4d41-4591-b4aa-d0a92d37433e tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] 10.222.0.41 "POST /compute/v2.1/servers/d3e49793-145c-4fea-979c-3875adb1ef35/action" status: 202 len: 0 microversion: 2.1 time: 0.390736 May 26 12:59:30.707648 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 540/1075] 10.222.0.41 () {60 vars in 1277 bytes} [Thu May 26 12:59:30 2022] POST /compute/v2.1/servers/d3e49793-145c-4fea-979c-3875adb1ef35/action => generated 0 bytes in 392 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 12:59:30.716860 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-e3ace2e7-8417-4606-bc89-ea438dd9a649 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:59:30.717967 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-e3ace2e7-8417-4606-bc89-ea438dd9a649 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] [instance: d3e49793-145c-4fea-979c-3875adb1ef35] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:59:30.724102 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-e3ace2e7-8417-4606-bc89-ea438dd9a649 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:30.724336 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-e3ace2e7-8417-4606-bc89-ea438dd9a649 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:30.725127 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-e3ace2e7-8417-4606-bc89-ea438dd9a649 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:30.725799 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-e3ace2e7-8417-4606-bc89-ea438dd9a649 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:30.873189 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-e3ace2e7-8417-4606-bc89-ea438dd9a649 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03ca4f264eb42ddbe92f5cb95d9fc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2ea80ac0374c2c870a494adc6534ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:59:30.881043 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-e3ace2e7-8417-4606-bc89-ea438dd9a649 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] 10.222.0.41 "GET /compute/v2.1/servers/d3e49793-145c-4fea-979c-3875adb1ef35" status: 200 len: 1516 microversion: 2.1 time: 0.168853 May 26 12:59:30.881888 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 536/1076] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:59:30 2022] GET /compute/v2.1/servers/d3e49793-145c-4fea-979c-3875adb1ef35 => generated 1516 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:59:31.899504 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-737d2a75-f8c8-479e-b66a-e37ba94d0d53 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:59:31.900155 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-737d2a75-f8c8-479e-b66a-e37ba94d0d53 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] [instance: d3e49793-145c-4fea-979c-3875adb1ef35] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:59:31.910306 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-737d2a75-f8c8-479e-b66a-e37ba94d0d53 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:31.910761 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-737d2a75-f8c8-479e-b66a-e37ba94d0d53 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:31.911588 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-737d2a75-f8c8-479e-b66a-e37ba94d0d53 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:31.912021 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-737d2a75-f8c8-479e-b66a-e37ba94d0d53 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:32.041802 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-737d2a75-f8c8-479e-b66a-e37ba94d0d53 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03ca4f264eb42ddbe92f5cb95d9fc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2ea80ac0374c2c870a494adc6534ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:59:32.049619 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-737d2a75-f8c8-479e-b66a-e37ba94d0d53 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] 10.222.0.41 "GET /compute/v2.1/servers/d3e49793-145c-4fea-979c-3875adb1ef35" status: 200 len: 1516 microversion: 2.1 time: 0.154809 May 26 12:59:32.050232 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 541/1077] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:59:31 2022] GET /compute/v2.1/servers/d3e49793-145c-4fea-979c-3875adb1ef35 => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:59:32.689775 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [req-7466bcc7-1cbf-4237-85c5-138a8988f118 req-f805cb6e-dfaf-4510-a691-2f96c3e70555 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3e49793-145c-4fea-979c-3875adb1ef35", "name": "network-vif-unplugged", "status": "completed", "tag": "e52542b8-e1ca-485c-bbda-287934dde033"}]} {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:59:32.698873 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [req-7466bcc7-1cbf-4237-85c5-138a8988f118 req-f805cb6e-dfaf-4510-a691-2f96c3e70555 service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:32.699299 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [req-7466bcc7-1cbf-4237-85c5-138a8988f118 req-f805cb6e-dfaf-4510-a691-2f96c3e70555 service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:32.711302 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.compute.server_external_events [req-7466bcc7-1cbf-4237-85c5-138a8988f118 req-f805cb6e-dfaf-4510-a691-2f96c3e70555 service nova] Unable to find a host for instance d3e49793-145c-4fea-979c-3875adb1ef35. Dropping event network-vif-unplugged {{(pid=124823) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 26 12:59:32.712189 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [req-7466bcc7-1cbf-4237-85c5-138a8988f118 req-f805cb6e-dfaf-4510-a691-2f96c3e70555 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.026512 May 26 12:59:32.712770 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 537/1078] 10.222.0.41 () {64 vars in 1317 bytes} [Thu May 26 12:59:32 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 28 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 26 12:59:33.067369 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-c771d9a7-c9dd-4e0e-8384-d421f6fcf6c0 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:59:33.067975 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-c771d9a7-c9dd-4e0e-8384-d421f6fcf6c0 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] [instance: d3e49793-145c-4fea-979c-3875adb1ef35] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:59:33.076045 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-c771d9a7-c9dd-4e0e-8384-d421f6fcf6c0 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:33.076479 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-c771d9a7-c9dd-4e0e-8384-d421f6fcf6c0 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:33.077256 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-c771d9a7-c9dd-4e0e-8384-d421f6fcf6c0 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:33.077717 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-c771d9a7-c9dd-4e0e-8384-d421f6fcf6c0 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:33.213453 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-c771d9a7-c9dd-4e0e-8384-d421f6fcf6c0 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03ca4f264eb42ddbe92f5cb95d9fc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2ea80ac0374c2c870a494adc6534ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:59:33.221476 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-c771d9a7-c9dd-4e0e-8384-d421f6fcf6c0 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] 10.222.0.41 "GET /compute/v2.1/servers/d3e49793-145c-4fea-979c-3875adb1ef35" status: 200 len: 1516 microversion: 2.1 time: 0.158356 May 26 12:59:33.222120 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 542/1079] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:59:33 2022] GET /compute/v2.1/servers/d3e49793-145c-4fea-979c-3875adb1ef35 => generated 1516 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:59:34.239093 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-e16ee3c8-2a4a-4d4e-af6c-5253d108094d tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:59:34.239573 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-e16ee3c8-2a4a-4d4e-af6c-5253d108094d tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] [instance: d3e49793-145c-4fea-979c-3875adb1ef35] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:59:34.246290 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-e16ee3c8-2a4a-4d4e-af6c-5253d108094d tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:34.249050 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-e16ee3c8-2a4a-4d4e-af6c-5253d108094d tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:34.249050 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-e16ee3c8-2a4a-4d4e-af6c-5253d108094d tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:34.249050 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-e16ee3c8-2a4a-4d4e-af6c-5253d108094d tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:34.386641 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-e16ee3c8-2a4a-4d4e-af6c-5253d108094d tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03ca4f264eb42ddbe92f5cb95d9fc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2ea80ac0374c2c870a494adc6534ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:59:34.394156 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-e16ee3c8-2a4a-4d4e-af6c-5253d108094d tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] 10.222.0.41 "GET /compute/v2.1/servers/d3e49793-145c-4fea-979c-3875adb1ef35" status: 200 len: 1516 microversion: 2.1 time: 0.158920 May 26 12:59:34.394746 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 538/1080] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:59:34 2022] GET /compute/v2.1/servers/d3e49793-145c-4fea-979c-3875adb1ef35 => generated 1516 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:59:35.411672 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-692cce0f-1d04-414c-9b54-705a51289bf2 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:59:35.412324 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-692cce0f-1d04-414c-9b54-705a51289bf2 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] [instance: d3e49793-145c-4fea-979c-3875adb1ef35] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:59:35.419623 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-692cce0f-1d04-414c-9b54-705a51289bf2 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:35.420076 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-692cce0f-1d04-414c-9b54-705a51289bf2 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:35.420909 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-692cce0f-1d04-414c-9b54-705a51289bf2 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:35.421350 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-692cce0f-1d04-414c-9b54-705a51289bf2 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:35.556678 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-692cce0f-1d04-414c-9b54-705a51289bf2 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03ca4f264eb42ddbe92f5cb95d9fc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2ea80ac0374c2c870a494adc6534ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:59:35.564646 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-692cce0f-1d04-414c-9b54-705a51289bf2 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] 10.222.0.41 "GET /compute/v2.1/servers/d3e49793-145c-4fea-979c-3875adb1ef35" status: 200 len: 1516 microversion: 2.1 time: 0.156846 May 26 12:59:35.565227 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 543/1081] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:59:35 2022] GET /compute/v2.1/servers/d3e49793-145c-4fea-979c-3875adb1ef35 => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:59:36.581857 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-d9528922-724a-43fd-a177-b61325c7f9e2 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:59:36.582477 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-d9528922-724a-43fd-a177-b61325c7f9e2 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] [instance: d3e49793-145c-4fea-979c-3875adb1ef35] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:59:36.589007 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-d9528922-724a-43fd-a177-b61325c7f9e2 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:36.589467 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-d9528922-724a-43fd-a177-b61325c7f9e2 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:36.590535 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-d9528922-724a-43fd-a177-b61325c7f9e2 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:36.590974 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-d9528922-724a-43fd-a177-b61325c7f9e2 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:36.725146 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-d9528922-724a-43fd-a177-b61325c7f9e2 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03ca4f264eb42ddbe92f5cb95d9fc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2ea80ac0374c2c870a494adc6534ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:59:36.733430 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-d9528922-724a-43fd-a177-b61325c7f9e2 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] 10.222.0.41 "GET /compute/v2.1/servers/d3e49793-145c-4fea-979c-3875adb1ef35" status: 200 len: 1518 microversion: 2.1 time: 0.155414 May 26 12:59:36.733984 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 539/1082] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:59:36 2022] GET /compute/v2.1/servers/d3e49793-145c-4fea-979c-3875adb1ef35 => generated 1518 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:59:37.752101 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-051d6354-1c6e-4753-a73a-d78b957498ce tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:59:37.752692 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-051d6354-1c6e-4753-a73a-d78b957498ce tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] [instance: d3e49793-145c-4fea-979c-3875adb1ef35] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:59:37.759772 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-051d6354-1c6e-4753-a73a-d78b957498ce tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:37.762296 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-051d6354-1c6e-4753-a73a-d78b957498ce tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:37.762296 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-051d6354-1c6e-4753-a73a-d78b957498ce tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:37.762296 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-051d6354-1c6e-4753-a73a-d78b957498ce tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:37.892762 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-051d6354-1c6e-4753-a73a-d78b957498ce tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03ca4f264eb42ddbe92f5cb95d9fc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2ea80ac0374c2c870a494adc6534ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:59:37.900371 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-051d6354-1c6e-4753-a73a-d78b957498ce tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] 10.222.0.41 "GET /compute/v2.1/servers/d3e49793-145c-4fea-979c-3875adb1ef35" status: 200 len: 1574 microversion: 2.1 time: 0.152588 May 26 12:59:37.900943 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 544/1083] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:59:37 2022] GET /compute/v2.1/servers/d3e49793-145c-4fea-979c-3875adb1ef35 => generated 1574 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:59:38.917527 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-15d543e2-485c-4138-a02a-134e15d3dc76 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:59:38.918242 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-15d543e2-485c-4138-a02a-134e15d3dc76 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] [instance: d3e49793-145c-4fea-979c-3875adb1ef35] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:59:38.924716 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-15d543e2-485c-4138-a02a-134e15d3dc76 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:38.925166 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-15d543e2-485c-4138-a02a-134e15d3dc76 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:38.925991 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-15d543e2-485c-4138-a02a-134e15d3dc76 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:38.926428 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-15d543e2-485c-4138-a02a-134e15d3dc76 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:39.062003 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-15d543e2-485c-4138-a02a-134e15d3dc76 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03ca4f264eb42ddbe92f5cb95d9fc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2ea80ac0374c2c870a494adc6534ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:59:39.070281 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-15d543e2-485c-4138-a02a-134e15d3dc76 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] 10.222.0.41 "GET /compute/v2.1/servers/d3e49793-145c-4fea-979c-3875adb1ef35" status: 200 len: 1574 microversion: 2.1 time: 0.156837 May 26 12:59:39.070860 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 540/1084] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:59:38 2022] GET /compute/v2.1/servers/d3e49793-145c-4fea-979c-3875adb1ef35 => generated 1574 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:59:40.087623 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-29369640-31d8-46e2-95f9-75bdd2a5e7ed tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:59:40.088244 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-29369640-31d8-46e2-95f9-75bdd2a5e7ed tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] [instance: d3e49793-145c-4fea-979c-3875adb1ef35] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:59:40.095012 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-29369640-31d8-46e2-95f9-75bdd2a5e7ed tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:40.095557 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-29369640-31d8-46e2-95f9-75bdd2a5e7ed tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:40.096443 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-29369640-31d8-46e2-95f9-75bdd2a5e7ed tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:40.096887 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-29369640-31d8-46e2-95f9-75bdd2a5e7ed tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:40.232490 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-29369640-31d8-46e2-95f9-75bdd2a5e7ed tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03ca4f264eb42ddbe92f5cb95d9fc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2ea80ac0374c2c870a494adc6534ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:59:40.240352 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-29369640-31d8-46e2-95f9-75bdd2a5e7ed tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] 10.222.0.41 "GET /compute/v2.1/servers/d3e49793-145c-4fea-979c-3875adb1ef35" status: 200 len: 1574 microversion: 2.1 time: 0.157267 May 26 12:59:40.240919 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 545/1085] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:59:40 2022] GET /compute/v2.1/servers/d3e49793-145c-4fea-979c-3875adb1ef35 => generated 1574 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:59:41.258054 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-8bcb0c73-3e69-4fb9-8b19-ed51054eb9c7 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:59:41.262807 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-8bcb0c73-3e69-4fb9-8b19-ed51054eb9c7 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] [instance: d3e49793-145c-4fea-979c-3875adb1ef35] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:59:41.265517 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-8bcb0c73-3e69-4fb9-8b19-ed51054eb9c7 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:41.266004 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-8bcb0c73-3e69-4fb9-8b19-ed51054eb9c7 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:41.266789 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-8bcb0c73-3e69-4fb9-8b19-ed51054eb9c7 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:41.267374 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-8bcb0c73-3e69-4fb9-8b19-ed51054eb9c7 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:41.405297 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-8bcb0c73-3e69-4fb9-8b19-ed51054eb9c7 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03ca4f264eb42ddbe92f5cb95d9fc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2ea80ac0374c2c870a494adc6534ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:59:41.412961 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-8bcb0c73-3e69-4fb9-8b19-ed51054eb9c7 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] 10.222.0.41 "GET /compute/v2.1/servers/d3e49793-145c-4fea-979c-3875adb1ef35" status: 200 len: 1574 microversion: 2.1 time: 0.159128 May 26 12:59:41.414060 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 541/1086] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:59:41 2022] GET /compute/v2.1/servers/d3e49793-145c-4fea-979c-3875adb1ef35 => generated 1574 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:59:42.431443 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-2df65fc2-1700-4daa-ad58-00ede5123cfd tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:59:42.432059 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-2df65fc2-1700-4daa-ad58-00ede5123cfd tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] [instance: d3e49793-145c-4fea-979c-3875adb1ef35] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:59:42.438407 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-2df65fc2-1700-4daa-ad58-00ede5123cfd tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:42.438860 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-2df65fc2-1700-4daa-ad58-00ede5123cfd tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:42.439626 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-2df65fc2-1700-4daa-ad58-00ede5123cfd tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:42.440060 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-2df65fc2-1700-4daa-ad58-00ede5123cfd tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:42.459125 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG dbcounter [-] [124824] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:59:42.579987 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-2df65fc2-1700-4daa-ad58-00ede5123cfd tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03ca4f264eb42ddbe92f5cb95d9fc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2ea80ac0374c2c870a494adc6534ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:59:42.585473 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-2df65fc2-1700-4daa-ad58-00ede5123cfd tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] 10.222.0.41 "GET /compute/v2.1/servers/d3e49793-145c-4fea-979c-3875adb1ef35" status: 200 len: 1574 microversion: 2.1 time: 0.158117 May 26 12:59:42.586100 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 546/1087] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:59:42 2022] GET /compute/v2.1/servers/d3e49793-145c-4fea-979c-3875adb1ef35 => generated 1574 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:59:43.603415 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-4387bdf6-53d9-4b10-ab66-3b5c65c30d7e tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:59:43.604040 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-4387bdf6-53d9-4b10-ab66-3b5c65c30d7e tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] [instance: d3e49793-145c-4fea-979c-3875adb1ef35] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:59:43.611012 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-4387bdf6-53d9-4b10-ab66-3b5c65c30d7e tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:43.611502 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-4387bdf6-53d9-4b10-ab66-3b5c65c30d7e tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:43.612288 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-4387bdf6-53d9-4b10-ab66-3b5c65c30d7e tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:43.612735 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-4387bdf6-53d9-4b10-ab66-3b5c65c30d7e tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:43.749439 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-4387bdf6-53d9-4b10-ab66-3b5c65c30d7e tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03ca4f264eb42ddbe92f5cb95d9fc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2ea80ac0374c2c870a494adc6534ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:59:43.758322 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-4387bdf6-53d9-4b10-ab66-3b5c65c30d7e tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] 10.222.0.41 "GET /compute/v2.1/servers/d3e49793-145c-4fea-979c-3875adb1ef35" status: 200 len: 1574 microversion: 2.1 time: 0.159462 May 26 12:59:43.758907 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 542/1088] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:59:43 2022] GET /compute/v2.1/servers/d3e49793-145c-4fea-979c-3875adb1ef35 => generated 1574 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:59:44.775907 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-24a912fd-eaa4-4024-9e98-c8f3c65bf964 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:59:44.776511 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-24a912fd-eaa4-4024-9e98-c8f3c65bf964 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] [instance: d3e49793-145c-4fea-979c-3875adb1ef35] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:59:44.783107 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-24a912fd-eaa4-4024-9e98-c8f3c65bf964 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:44.783589 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-24a912fd-eaa4-4024-9e98-c8f3c65bf964 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:44.784309 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-24a912fd-eaa4-4024-9e98-c8f3c65bf964 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:44.784804 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-24a912fd-eaa4-4024-9e98-c8f3c65bf964 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:44.952904 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-24a912fd-eaa4-4024-9e98-c8f3c65bf964 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03ca4f264eb42ddbe92f5cb95d9fc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2ea80ac0374c2c870a494adc6534ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:59:44.961389 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-24a912fd-eaa4-4024-9e98-c8f3c65bf964 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] 10.222.0.41 "GET /compute/v2.1/servers/d3e49793-145c-4fea-979c-3875adb1ef35" status: 200 len: 1574 microversion: 2.1 time: 0.189999 May 26 12:59:44.962082 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 547/1089] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:59:44 2022] GET /compute/v2.1/servers/d3e49793-145c-4fea-979c-3875adb1ef35 => generated 1574 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:59:45.983451 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-689832d6-650f-46c8-9c93-bfc8728dba91 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:59:45.984723 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-689832d6-650f-46c8-9c93-bfc8728dba91 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] [instance: d3e49793-145c-4fea-979c-3875adb1ef35] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:59:45.996749 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-689832d6-650f-46c8-9c93-bfc8728dba91 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:45.997572 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-689832d6-650f-46c8-9c93-bfc8728dba91 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:45.999002 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-689832d6-650f-46c8-9c93-bfc8728dba91 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:45.999472 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-689832d6-650f-46c8-9c93-bfc8728dba91 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:46.143670 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-689832d6-650f-46c8-9c93-bfc8728dba91 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03ca4f264eb42ddbe92f5cb95d9fc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2ea80ac0374c2c870a494adc6534ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:59:46.152137 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-689832d6-650f-46c8-9c93-bfc8728dba91 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] 10.222.0.41 "GET /compute/v2.1/servers/d3e49793-145c-4fea-979c-3875adb1ef35" status: 200 len: 1574 microversion: 2.1 time: 0.177201 May 26 12:59:46.152637 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 543/1090] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:59:45 2022] GET /compute/v2.1/servers/d3e49793-145c-4fea-979c-3875adb1ef35 => generated 1574 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:59:47.169070 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-0737483f-ee2b-4869-b5c2-e7a1d02675e9 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:59:47.169754 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-0737483f-ee2b-4869-b5c2-e7a1d02675e9 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] [instance: d3e49793-145c-4fea-979c-3875adb1ef35] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:59:47.172165 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG dbcounter [-] [124824] Writing DB stats nova_api:SELECT=38 {{(pid=124824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:59:47.177229 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-0737483f-ee2b-4869-b5c2-e7a1d02675e9 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:47.177702 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-0737483f-ee2b-4869-b5c2-e7a1d02675e9 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:47.179218 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-0737483f-ee2b-4869-b5c2-e7a1d02675e9 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:47.179812 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-0737483f-ee2b-4869-b5c2-e7a1d02675e9 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:47.328007 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-0737483f-ee2b-4869-b5c2-e7a1d02675e9 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03ca4f264eb42ddbe92f5cb95d9fc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2ea80ac0374c2c870a494adc6534ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:59:47.336808 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-0737483f-ee2b-4869-b5c2-e7a1d02675e9 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] 10.222.0.41 "GET /compute/v2.1/servers/d3e49793-145c-4fea-979c-3875adb1ef35" status: 200 len: 1574 microversion: 2.1 time: 0.171506 May 26 12:59:47.338043 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 548/1091] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:59:47 2022] GET /compute/v2.1/servers/d3e49793-145c-4fea-979c-3875adb1ef35 => generated 1574 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:59:48.362293 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-0afa0920-85c2-4654-a16c-0b91d33450df tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:59:48.362905 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-0afa0920-85c2-4654-a16c-0b91d33450df tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] [instance: d3e49793-145c-4fea-979c-3875adb1ef35] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:59:48.365291 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG dbcounter [-] [124823] Writing DB stats nova_api:SELECT=31 {{(pid=124823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:59:48.370664 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-0afa0920-85c2-4654-a16c-0b91d33450df tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:48.371115 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-0afa0920-85c2-4654-a16c-0b91d33450df tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:48.371881 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-0afa0920-85c2-4654-a16c-0b91d33450df tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:48.372316 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-0afa0920-85c2-4654-a16c-0b91d33450df tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:48.376278 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG dbcounter [-] [124823] Writing DB stats nova_cell1:SELECT=87 {{(pid=124823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:59:48.508179 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-0afa0920-85c2-4654-a16c-0b91d33450df tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03ca4f264eb42ddbe92f5cb95d9fc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2ea80ac0374c2c870a494adc6534ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:59:48.515728 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-0afa0920-85c2-4654-a16c-0b91d33450df tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] 10.222.0.41 "GET /compute/v2.1/servers/d3e49793-145c-4fea-979c-3875adb1ef35" status: 200 len: 1574 microversion: 2.1 time: 0.157373 May 26 12:59:48.516302 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 544/1092] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:59:48 2022] GET /compute/v2.1/servers/d3e49793-145c-4fea-979c-3875adb1ef35 => generated 1574 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:59:48.823281 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [req-25af1948-bcdc-4206-aefa-964c26cd8f5d req-8ba4b301-918d-4927-a73f-c403ec3ce8ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3e49793-145c-4fea-979c-3875adb1ef35", "name": "network-vif-plugged", "status": "completed", "tag": "e52542b8-e1ca-485c-bbda-287934dde033"}]} {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:59:48.832258 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [req-25af1948-bcdc-4206-aefa-964c26cd8f5d req-8ba4b301-918d-4927-a73f-c403ec3ce8ff service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:48.832699 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [req-25af1948-bcdc-4206-aefa-964c26cd8f5d req-8ba4b301-918d-4927-a73f-c403ec3ce8ff service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:48.844611 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.compute.server_external_events [req-25af1948-bcdc-4206-aefa-964c26cd8f5d req-8ba4b301-918d-4927-a73f-c403ec3ce8ff service nova] Creating event network-vif-plugged:e52542b8-e1ca-485c-bbda-287934dde033 for instance d3e49793-145c-4fea-979c-3875adb1ef35 on hv-cinder-81571 May 26 12:59:48.850378 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [req-25af1948-bcdc-4206-aefa-964c26cd8f5d req-8ba4b301-918d-4927-a73f-c403ec3ce8ff service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030117 May 26 12:59:48.850970 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 549/1093] 10.222.0.41 () {64 vars in 1317 bytes} [Thu May 26 12:59:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:59:49.532538 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-53ca53d4-ffde-4259-a592-b825c7dfe04f tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:59:49.533163 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-53ca53d4-ffde-4259-a592-b825c7dfe04f tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] [instance: d3e49793-145c-4fea-979c-3875adb1ef35] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:59:49.539854 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-53ca53d4-ffde-4259-a592-b825c7dfe04f tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:49.540295 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-53ca53d4-ffde-4259-a592-b825c7dfe04f tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:49.541051 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-53ca53d4-ffde-4259-a592-b825c7dfe04f tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:49.541478 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-53ca53d4-ffde-4259-a592-b825c7dfe04f tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:49.670493 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-53ca53d4-ffde-4259-a592-b825c7dfe04f tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03ca4f264eb42ddbe92f5cb95d9fc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2ea80ac0374c2c870a494adc6534ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:59:49.678619 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-53ca53d4-ffde-4259-a592-b825c7dfe04f tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] 10.222.0.41 "GET /compute/v2.1/servers/d3e49793-145c-4fea-979c-3875adb1ef35" status: 200 len: 1574 microversion: 2.1 time: 0.149604 May 26 12:59:49.679199 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 545/1094] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:59:49 2022] GET /compute/v2.1/servers/d3e49793-145c-4fea-979c-3875adb1ef35 => generated 1574 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:59:50.428551 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-baf2861b-b741-47a4-9358-c7df950856a1 tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-893866950", "imageRef": "6df25342-b071-489b-a7c1-3089fa19af6d", "flavorRef": "452"}} {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:59:50.484131 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.network.neutron [None req-baf2861b-b741-47a4-9358-c7df950856a1 tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] validate_networks() for None {{(pid=124824) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 12:59:50.696557 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-ba3d6897-fd25-409b-9a79-8dd5de94a126 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:59:50.697273 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-ba3d6897-fd25-409b-9a79-8dd5de94a126 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] [instance: d3e49793-145c-4fea-979c-3875adb1ef35] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:59:50.704000 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-ba3d6897-fd25-409b-9a79-8dd5de94a126 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:50.704465 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-ba3d6897-fd25-409b-9a79-8dd5de94a126 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:50.705329 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-ba3d6897-fd25-409b-9a79-8dd5de94a126 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:50.706001 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-ba3d6897-fd25-409b-9a79-8dd5de94a126 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:50.761969 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.virt.hardware [None req-baf2861b-b741-47a4-9358-c7df950856a1 tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] Flavor limits 0:0:0 {{(pid=124824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 12:59:50.762444 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.virt.hardware [None req-baf2861b-b741-47a4-9358-c7df950856a1 tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] Image limits 0:0:0 {{(pid=124824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 12:59:50.762921 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.virt.hardware [None req-baf2861b-b741-47a4-9358-c7df950856a1 tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] Flavor pref 0:0:0 {{(pid=124824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 12:59:50.763346 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.virt.hardware [None req-baf2861b-b741-47a4-9358-c7df950856a1 tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] Image pref 0:0:0 {{(pid=124824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 12:59:50.763751 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.virt.hardware [None req-baf2861b-b741-47a4-9358-c7df950856a1 tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 12:59:50.779348 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-baf2861b-b741-47a4-9358-c7df950856a1 tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:50.780370 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-baf2861b-b741-47a4-9358-c7df950856a1 tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:50.780606 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-baf2861b-b741-47a4-9358-c7df950856a1 tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:50.781051 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-baf2861b-b741-47a4-9358-c7df950856a1 tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:50.798619 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.quota [None req-baf2861b-b741-47a4-9358-c7df950856a1 tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] Getting quotas for project bfbb1ec8872f42218abf14ed8ada2e89. Resources: {'instances', 'ram', 'cores'} {{(pid=124824) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 12:59:50.802667 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.quota [None req-baf2861b-b741-47a4-9358-c7df950856a1 tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] Getting quotas for user 42918efc43ac4c96b5b5cb8f0c9ae52a and project bfbb1ec8872f42218abf14ed8ada2e89. Resources: {'instances', 'ram', 'cores'} {{(pid=124824) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 12:59:50.813950 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-baf2861b-b741-47a4-9358-c7df950856a1 tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] Going to run 1 instances... {{(pid=124824) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 12:59:50.816247 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-baf2861b-b741-47a4-9358-c7df950856a1 tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] [instance: 710a7fee-caa1-4364-a32a-aec390a254ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6df25342-b071-489b-a7c1-3089fa19af6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124824) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 12:59:50.843333 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-ba3d6897-fd25-409b-9a79-8dd5de94a126 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03ca4f264eb42ddbe92f5cb95d9fc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2ea80ac0374c2c870a494adc6534ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:59:50.850502 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-ba3d6897-fd25-409b-9a79-8dd5de94a126 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] 10.222.0.41 "GET /compute/v2.1/servers/d3e49793-145c-4fea-979c-3875adb1ef35" status: 200 len: 1561 microversion: 2.1 time: 0.158595 May 26 12:59:50.851072 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 546/1095] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:59:50 2022] GET /compute/v2.1/servers/d3e49793-145c-4fea-979c-3875adb1ef35 => generated 1561 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 12:59:50.938945 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-baf2861b-b741-47a4-9358-c7df950856a1 tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.515381 May 26 12:59:50.939487 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 550/1096] 10.222.0.41 () {60 vars in 1146 bytes} [Thu May 26 12:59:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 517 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 12:59:50.949975 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-9a77b66d-6991-4b65-8de4-ab71223dc89b tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:59:50.950583 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-9a77b66d-6991-4b65-8de4-ab71223dc89b tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] [instance: 710a7fee-caa1-4364-a32a-aec390a254ec] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:59:51.003892 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-9a77b66d-6991-4b65-8de4-ab71223dc89b tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42918efc43ac4c96b5b5cb8f0c9ae52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfbb1ec8872f42218abf14ed8ada2e89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:59:51.012198 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-9a77b66d-6991-4b65-8de4-ab71223dc89b tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] 10.222.0.41 "GET /compute/v2.1/servers/710a7fee-caa1-4364-a32a-aec390a254ec" status: 200 len: 1214 microversion: 2.1 time: 0.066037 May 26 12:59:51.012759 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 547/1097] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:59:50 2022] GET /compute/v2.1/servers/710a7fee-caa1-4364-a32a-aec390a254ec => generated 1214 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:59:52.029390 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-33a28a1f-4b26-4d92-9344-4961f77e0699 tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:59:52.029966 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-33a28a1f-4b26-4d92-9344-4961f77e0699 tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] [instance: 710a7fee-caa1-4364-a32a-aec390a254ec] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:59:52.037162 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-33a28a1f-4b26-4d92-9344-4961f77e0699 tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:52.038373 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-33a28a1f-4b26-4d92-9344-4961f77e0699 tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:52.038548 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-33a28a1f-4b26-4d92-9344-4961f77e0699 tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:52.038883 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-33a28a1f-4b26-4d92-9344-4961f77e0699 tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:52.100837 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-33a28a1f-4b26-4d92-9344-4961f77e0699 tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42918efc43ac4c96b5b5cb8f0c9ae52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfbb1ec8872f42218abf14ed8ada2e89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:59:52.108456 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-33a28a1f-4b26-4d92-9344-4961f77e0699 tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] 10.222.0.41 "GET /compute/v2.1/servers/710a7fee-caa1-4364-a32a-aec390a254ec" status: 200 len: 1218 microversion: 2.1 time: 0.083499 May 26 12:59:52.109023 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 551/1098] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:59:52 2022] GET /compute/v2.1/servers/710a7fee-caa1-4364-a32a-aec390a254ec => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:59:53.128266 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-8375c453-2bbc-4f5f-b086-8caddf68e3eb tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:59:53.128977 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-8375c453-2bbc-4f5f-b086-8caddf68e3eb tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] [instance: 710a7fee-caa1-4364-a32a-aec390a254ec] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:59:53.138260 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-8375c453-2bbc-4f5f-b086-8caddf68e3eb tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:53.142102 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-8375c453-2bbc-4f5f-b086-8caddf68e3eb tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:53.142102 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-8375c453-2bbc-4f5f-b086-8caddf68e3eb tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:53.142102 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-8375c453-2bbc-4f5f-b086-8caddf68e3eb tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:53.201946 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-8375c453-2bbc-4f5f-b086-8caddf68e3eb tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42918efc43ac4c96b5b5cb8f0c9ae52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfbb1ec8872f42218abf14ed8ada2e89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:59:53.210361 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-8375c453-2bbc-4f5f-b086-8caddf68e3eb tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] 10.222.0.41 "GET /compute/v2.1/servers/710a7fee-caa1-4364-a32a-aec390a254ec" status: 200 len: 1274 microversion: 2.1 time: 0.086003 May 26 12:59:53.211383 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 548/1099] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:59:53 2022] GET /compute/v2.1/servers/710a7fee-caa1-4364-a32a-aec390a254ec => generated 1274 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:59:54.228113 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-6deb4aee-bf35-4a50-b7f8-4db85004b6b3 tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:59:54.229240 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-6deb4aee-bf35-4a50-b7f8-4db85004b6b3 tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] [instance: 710a7fee-caa1-4364-a32a-aec390a254ec] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:59:54.238031 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-6deb4aee-bf35-4a50-b7f8-4db85004b6b3 tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:54.238031 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-6deb4aee-bf35-4a50-b7f8-4db85004b6b3 tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:54.238031 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-6deb4aee-bf35-4a50-b7f8-4db85004b6b3 tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:54.238031 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-6deb4aee-bf35-4a50-b7f8-4db85004b6b3 tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:54.460179 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-6deb4aee-bf35-4a50-b7f8-4db85004b6b3 tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42918efc43ac4c96b5b5cb8f0c9ae52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfbb1ec8872f42218abf14ed8ada2e89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:59:54.467867 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-6deb4aee-bf35-4a50-b7f8-4db85004b6b3 tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] 10.222.0.41 "GET /compute/v2.1/servers/710a7fee-caa1-4364-a32a-aec390a254ec" status: 200 len: 1314 microversion: 2.1 time: 0.243658 May 26 12:59:54.468437 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 552/1100] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:59:54 2022] GET /compute/v2.1/servers/710a7fee-caa1-4364-a32a-aec390a254ec => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:59:55.099234 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [req-6763ffea-da82-4555-a5c1-1139c3061d54 req-180032cf-d62f-49ea-a829-8ecced9af382 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "710a7fee-caa1-4364-a32a-aec390a254ec", "tag": "052bf98b-419f-4aa9-aef5-6c5fef89e01d"}]} {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 12:59:55.108599 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [req-6763ffea-da82-4555-a5c1-1139c3061d54 req-180032cf-d62f-49ea-a829-8ecced9af382 service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:55.109055 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [req-6763ffea-da82-4555-a5c1-1139c3061d54 req-180032cf-d62f-49ea-a829-8ecced9af382 service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:55.122723 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.compute.server_external_events [req-6763ffea-da82-4555-a5c1-1139c3061d54 req-180032cf-d62f-49ea-a829-8ecced9af382 service nova] Creating event network-changed:052bf98b-419f-4aa9-aef5-6c5fef89e01d for instance 710a7fee-caa1-4364-a32a-aec390a254ec on hv-cinder-81571 May 26 12:59:55.128240 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [req-6763ffea-da82-4555-a5c1-1139c3061d54 req-180032cf-d62f-49ea-a829-8ecced9af382 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033591 May 26 12:59:55.132356 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 549/1101] 10.222.0.41 () {64 vars in 1317 bytes} [Thu May 26 12:59:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 12:59:55.484305 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-9a9b5dc3-e5a6-41da-804d-b81d7e38e480 tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:59:55.484842 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-9a9b5dc3-e5a6-41da-804d-b81d7e38e480 tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] [instance: 710a7fee-caa1-4364-a32a-aec390a254ec] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:59:55.491610 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-9a9b5dc3-e5a6-41da-804d-b81d7e38e480 tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:55.492063 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-9a9b5dc3-e5a6-41da-804d-b81d7e38e480 tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:55.492840 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-9a9b5dc3-e5a6-41da-804d-b81d7e38e480 tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:55.493279 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-9a9b5dc3-e5a6-41da-804d-b81d7e38e480 tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:55.699437 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-9a9b5dc3-e5a6-41da-804d-b81d7e38e480 tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42918efc43ac4c96b5b5cb8f0c9ae52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfbb1ec8872f42218abf14ed8ada2e89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:59:55.707242 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-9a9b5dc3-e5a6-41da-804d-b81d7e38e480 tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] 10.222.0.41 "GET /compute/v2.1/servers/710a7fee-caa1-4364-a32a-aec390a254ec" status: 200 len: 1314 microversion: 2.1 time: 0.226836 May 26 12:59:55.707827 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 553/1102] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:59:55 2022] GET /compute/v2.1/servers/710a7fee-caa1-4364-a32a-aec390a254ec => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:59:56.725472 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-ad78ad69-5795-4cf1-8d4c-6a47df0584e3 tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:59:56.726194 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-ad78ad69-5795-4cf1-8d4c-6a47df0584e3 tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] [instance: 710a7fee-caa1-4364-a32a-aec390a254ec] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:59:56.732381 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-ad78ad69-5795-4cf1-8d4c-6a47df0584e3 tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:56.732826 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-ad78ad69-5795-4cf1-8d4c-6a47df0584e3 tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:56.733590 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-ad78ad69-5795-4cf1-8d4c-6a47df0584e3 tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:56.734046 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-ad78ad69-5795-4cf1-8d4c-6a47df0584e3 tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:56.864147 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-ad78ad69-5795-4cf1-8d4c-6a47df0584e3 tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42918efc43ac4c96b5b5cb8f0c9ae52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfbb1ec8872f42218abf14ed8ada2e89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:59:56.871522 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-ad78ad69-5795-4cf1-8d4c-6a47df0584e3 tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] 10.222.0.41 "GET /compute/v2.1/servers/710a7fee-caa1-4364-a32a-aec390a254ec" status: 200 len: 1314 microversion: 2.1 time: 0.150744 May 26 12:59:56.872100 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 550/1103] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:59:56 2022] GET /compute/v2.1/servers/710a7fee-caa1-4364-a32a-aec390a254ec => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:59:57.888348 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-62e55788-8722-4ceb-a1a6-ab216447d1f9 tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:59:57.888964 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-62e55788-8722-4ceb-a1a6-ab216447d1f9 tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] [instance: 710a7fee-caa1-4364-a32a-aec390a254ec] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:59:57.895601 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-62e55788-8722-4ceb-a1a6-ab216447d1f9 tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:57.896044 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-62e55788-8722-4ceb-a1a6-ab216447d1f9 tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:57.897313 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-62e55788-8722-4ceb-a1a6-ab216447d1f9 tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:57.897766 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-62e55788-8722-4ceb-a1a6-ab216447d1f9 tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:58.029349 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-62e55788-8722-4ceb-a1a6-ab216447d1f9 tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42918efc43ac4c96b5b5cb8f0c9ae52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfbb1ec8872f42218abf14ed8ada2e89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:59:58.036735 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-62e55788-8722-4ceb-a1a6-ab216447d1f9 tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] 10.222.0.41 "GET /compute/v2.1/servers/710a7fee-caa1-4364-a32a-aec390a254ec" status: 200 len: 1314 microversion: 2.1 time: 0.152317 May 26 12:59:58.037939 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 554/1104] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:59:57 2022] GET /compute/v2.1/servers/710a7fee-caa1-4364-a32a-aec390a254ec => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 12:59:59.053980 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-16a32a5f-f86b-4c30-8ecc-0d3ab5ee908d tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 12:59:59.054599 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-16a32a5f-f86b-4c30-8ecc-0d3ab5ee908d tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] [instance: 710a7fee-caa1-4364-a32a-aec390a254ec] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 12:59:59.061243 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-16a32a5f-f86b-4c30-8ecc-0d3ab5ee908d tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:59.061716 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-16a32a5f-f86b-4c30-8ecc-0d3ab5ee908d tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:59.062483 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-16a32a5f-f86b-4c30-8ecc-0d3ab5ee908d tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 12:59:59.062920 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-16a32a5f-f86b-4c30-8ecc-0d3ab5ee908d tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 12:59:59.194388 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-16a32a5f-f86b-4c30-8ecc-0d3ab5ee908d tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42918efc43ac4c96b5b5cb8f0c9ae52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfbb1ec8872f42218abf14ed8ada2e89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 12:59:59.202434 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-16a32a5f-f86b-4c30-8ecc-0d3ab5ee908d tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] 10.222.0.41 "GET /compute/v2.1/servers/710a7fee-caa1-4364-a32a-aec390a254ec" status: 200 len: 1314 microversion: 2.1 time: 0.152223 May 26 12:59:59.203157 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 551/1105] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 12:59:59 2022] GET /compute/v2.1/servers/710a7fee-caa1-4364-a32a-aec390a254ec => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:00:00.219919 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-cc57325b-934c-4595-bf1f-382afdfc501d tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:00:00.220568 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-cc57325b-934c-4595-bf1f-382afdfc501d tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] [instance: 710a7fee-caa1-4364-a32a-aec390a254ec] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:00:00.227170 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-cc57325b-934c-4595-bf1f-382afdfc501d tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:00:00.227647 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-cc57325b-934c-4595-bf1f-382afdfc501d tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:00:00.228418 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-cc57325b-934c-4595-bf1f-382afdfc501d tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:00:00.228857 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-cc57325b-934c-4595-bf1f-382afdfc501d tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:00:00.355708 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-cc57325b-934c-4595-bf1f-382afdfc501d tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42918efc43ac4c96b5b5cb8f0c9ae52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfbb1ec8872f42218abf14ed8ada2e89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:00:00.363316 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-cc57325b-934c-4595-bf1f-382afdfc501d tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] 10.222.0.41 "GET /compute/v2.1/servers/710a7fee-caa1-4364-a32a-aec390a254ec" status: 200 len: 1314 microversion: 2.1 time: 0.147303 May 26 13:00:00.368907 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 555/1106] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 13:00:00 2022] GET /compute/v2.1/servers/710a7fee-caa1-4364-a32a-aec390a254ec => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:00:00.957933 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [req-25819f7e-c385-42c5-8a2a-f31202ab2c1f req-f60260db-dea1-49c1-b892-98941a524f4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "710a7fee-caa1-4364-a32a-aec390a254ec", "name": "network-vif-plugged", "status": "completed", "tag": "052bf98b-419f-4aa9-aef5-6c5fef89e01d"}]} {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:00:00.966990 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [req-25819f7e-c385-42c5-8a2a-f31202ab2c1f req-f60260db-dea1-49c1-b892-98941a524f4a service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:00:00.967445 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [req-25819f7e-c385-42c5-8a2a-f31202ab2c1f req-f60260db-dea1-49c1-b892-98941a524f4a service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:00:00.979256 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.compute.server_external_events [req-25819f7e-c385-42c5-8a2a-f31202ab2c1f req-f60260db-dea1-49c1-b892-98941a524f4a service nova] Creating event network-vif-plugged:052bf98b-419f-4aa9-aef5-6c5fef89e01d for instance 710a7fee-caa1-4364-a32a-aec390a254ec on hv-cinder-81571 May 26 13:00:00.984376 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [req-25819f7e-c385-42c5-8a2a-f31202ab2c1f req-f60260db-dea1-49c1-b892-98941a524f4a service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030346 May 26 13:00:00.985420 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 552/1107] 10.222.0.41 () {64 vars in 1317 bytes} [Thu May 26 13:00:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:00:01.381255 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-eb94987b-2aea-4da5-a879-8abfa3316762 tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:00:01.381910 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-eb94987b-2aea-4da5-a879-8abfa3316762 tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] [instance: 710a7fee-caa1-4364-a32a-aec390a254ec] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:00:01.383903 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG dbcounter [-] [124824] Writing DB stats nova_cell0:SELECT=2 {{(pid=124824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:00:01.384614 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG dbcounter [-] [124824] Writing DB stats nova_cell0:SELECT=6 {{(pid=124824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:00:01.390073 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-eb94987b-2aea-4da5-a879-8abfa3316762 tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:00:01.391691 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-eb94987b-2aea-4da5-a879-8abfa3316762 tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:00:01.391691 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-eb94987b-2aea-4da5-a879-8abfa3316762 tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:00:01.391691 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-eb94987b-2aea-4da5-a879-8abfa3316762 tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:00:01.522110 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-eb94987b-2aea-4da5-a879-8abfa3316762 tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42918efc43ac4c96b5b5cb8f0c9ae52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfbb1ec8872f42218abf14ed8ada2e89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:00:01.530143 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-eb94987b-2aea-4da5-a879-8abfa3316762 tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] 10.222.0.41 "GET /compute/v2.1/servers/710a7fee-caa1-4364-a32a-aec390a254ec" status: 200 len: 1314 microversion: 2.1 time: 0.153272 May 26 13:00:01.530728 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 556/1108] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 13:00:01 2022] GET /compute/v2.1/servers/710a7fee-caa1-4364-a32a-aec390a254ec => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:00:02.548261 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-73568960-1495-4b09-8788-ae4623b00d50 tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:00:02.548968 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-73568960-1495-4b09-8788-ae4623b00d50 tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] [instance: 710a7fee-caa1-4364-a32a-aec390a254ec] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:00:02.551132 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG dbcounter [-] [124823] Writing DB stats nova_cell0:SELECT=2 {{(pid=124823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:00:02.556868 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-73568960-1495-4b09-8788-ae4623b00d50 tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:00:02.557435 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-73568960-1495-4b09-8788-ae4623b00d50 tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:00:02.558296 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-73568960-1495-4b09-8788-ae4623b00d50 tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:00:02.558733 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-73568960-1495-4b09-8788-ae4623b00d50 tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:00:02.697030 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-73568960-1495-4b09-8788-ae4623b00d50 tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42918efc43ac4c96b5b5cb8f0c9ae52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfbb1ec8872f42218abf14ed8ada2e89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:00:02.704612 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-73568960-1495-4b09-8788-ae4623b00d50 tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] 10.222.0.41 "GET /compute/v2.1/servers/710a7fee-caa1-4364-a32a-aec390a254ec" status: 200 len: 1314 microversion: 2.1 time: 0.160669 May 26 13:00:02.705203 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 553/1109] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 13:00:02 2022] GET /compute/v2.1/servers/710a7fee-caa1-4364-a32a-aec390a254ec => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:00:03.722483 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-b36f2efb-b511-41d5-b15a-3fc6a775842f tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:00:03.723152 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-b36f2efb-b511-41d5-b15a-3fc6a775842f tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] [instance: 710a7fee-caa1-4364-a32a-aec390a254ec] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:00:03.730061 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-b36f2efb-b511-41d5-b15a-3fc6a775842f tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:00:03.730511 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-b36f2efb-b511-41d5-b15a-3fc6a775842f tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:00:03.731291 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-b36f2efb-b511-41d5-b15a-3fc6a775842f tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:00:03.731731 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-b36f2efb-b511-41d5-b15a-3fc6a775842f tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:00:03.871094 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-b36f2efb-b511-41d5-b15a-3fc6a775842f tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42918efc43ac4c96b5b5cb8f0c9ae52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfbb1ec8872f42218abf14ed8ada2e89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:00:03.878683 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-b36f2efb-b511-41d5-b15a-3fc6a775842f tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] 10.222.0.41 "GET /compute/v2.1/servers/710a7fee-caa1-4364-a32a-aec390a254ec" status: 200 len: 1464 microversion: 2.1 time: 0.160357 May 26 13:00:03.879265 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 557/1110] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 13:00:03 2022] GET /compute/v2.1/servers/710a7fee-caa1-4364-a32a-aec390a254ec => generated 1464 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:00:03.922340 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-4d0ff6dd-2ef7-4aa6-9ac5-b9a48a59df1d tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:00:03.922900 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-4d0ff6dd-2ef7-4aa6-9ac5-b9a48a59df1d tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] [instance: 710a7fee-caa1-4364-a32a-aec390a254ec] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:00:03.930377 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-4d0ff6dd-2ef7-4aa6-9ac5-b9a48a59df1d tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:00:03.930879 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-4d0ff6dd-2ef7-4aa6-9ac5-b9a48a59df1d tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:00:03.931664 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-4d0ff6dd-2ef7-4aa6-9ac5-b9a48a59df1d tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:00:03.932110 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-4d0ff6dd-2ef7-4aa6-9ac5-b9a48a59df1d tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:00:03.959551 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-4d0ff6dd-2ef7-4aa6-9ac5-b9a48a59df1d tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] [instance: 710a7fee-caa1-4364-a32a-aec390a254ec] Going to try to terminate instance {{(pid=124823) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 13:00:04.235604 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-4d0ff6dd-2ef7-4aa6-9ac5-b9a48a59df1d tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] 10.222.0.41 "DELETE /compute/v2.1/servers/710a7fee-caa1-4364-a32a-aec390a254ec" status: 204 len: 0 microversion: 2.1 time: 0.317509 May 26 13:00:04.236202 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 554/1111] 10.222.0.41 () {58 vars in 1238 bytes} [Thu May 26 13:00:03 2022] DELETE /compute/v2.1/servers/710a7fee-caa1-4364-a32a-aec390a254ec => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 13:00:04.250307 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-0eda660f-0a15-4798-966f-2f77bfe517b8 tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:00:04.250917 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-0eda660f-0a15-4798-966f-2f77bfe517b8 tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] [instance: 710a7fee-caa1-4364-a32a-aec390a254ec] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:00:04.257300 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-0eda660f-0a15-4798-966f-2f77bfe517b8 tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:00:04.257894 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-0eda660f-0a15-4798-966f-2f77bfe517b8 tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:00:04.258673 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-0eda660f-0a15-4798-966f-2f77bfe517b8 tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:00:04.259106 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-0eda660f-0a15-4798-966f-2f77bfe517b8 tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:00:04.391556 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-0eda660f-0a15-4798-966f-2f77bfe517b8 tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42918efc43ac4c96b5b5cb8f0c9ae52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfbb1ec8872f42218abf14ed8ada2e89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:00:04.399730 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-0eda660f-0a15-4798-966f-2f77bfe517b8 tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] 10.222.0.41 "GET /compute/v2.1/servers/710a7fee-caa1-4364-a32a-aec390a254ec" status: 200 len: 1470 microversion: 2.1 time: 0.153303 May 26 13:00:04.400301 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 558/1112] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 13:00:04 2022] GET /compute/v2.1/servers/710a7fee-caa1-4364-a32a-aec390a254ec => generated 1470 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:00:04.949313 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 13:00:04.949941 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Thu May 26 13:00:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 13:00:05.418208 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-baed9fb2-d71a-4d4d-b5b3-933038b5a735 tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:00:05.418938 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-baed9fb2-d71a-4d4d-b5b3-933038b5a735 tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] [instance: 710a7fee-caa1-4364-a32a-aec390a254ec] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:00:05.425464 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-baed9fb2-d71a-4d4d-b5b3-933038b5a735 tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:00:05.425950 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-baed9fb2-d71a-4d4d-b5b3-933038b5a735 tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:00:05.426761 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-baed9fb2-d71a-4d4d-b5b3-933038b5a735 tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:00:05.427203 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-baed9fb2-d71a-4d4d-b5b3-933038b5a735 tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:00:05.555800 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-baed9fb2-d71a-4d4d-b5b3-933038b5a735 tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42918efc43ac4c96b5b5cb8f0c9ae52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfbb1ec8872f42218abf14ed8ada2e89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:00:05.563147 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-baed9fb2-d71a-4d4d-b5b3-933038b5a735 tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] 10.222.0.41 "GET /compute/v2.1/servers/710a7fee-caa1-4364-a32a-aec390a254ec" status: 200 len: 1470 microversion: 2.1 time: 0.149877 May 26 13:00:05.563711 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 555/1113] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 13:00:05 2022] GET /compute/v2.1/servers/710a7fee-caa1-4364-a32a-aec390a254ec => generated 1470 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:00:06.176626 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [req-0fe3d63d-58a5-40ae-a7d6-4e6ae024022f req-0d9eeaf0-d90e-4274-9f76-b05032af9e9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "710a7fee-caa1-4364-a32a-aec390a254ec", "name": "network-vif-deleted", "tag": "052bf98b-419f-4aa9-aef5-6c5fef89e01d"}]} {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:00:06.186258 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [req-0fe3d63d-58a5-40ae-a7d6-4e6ae024022f req-0d9eeaf0-d90e-4274-9f76-b05032af9e9f service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:00:06.191344 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [req-0fe3d63d-58a5-40ae-a7d6-4e6ae024022f req-0d9eeaf0-d90e-4274-9f76-b05032af9e9f service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:00:06.199432 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.compute.server_external_events [req-0fe3d63d-58a5-40ae-a7d6-4e6ae024022f req-0d9eeaf0-d90e-4274-9f76-b05032af9e9f service nova] Creating event network-vif-deleted:052bf98b-419f-4aa9-aef5-6c5fef89e01d for instance 710a7fee-caa1-4364-a32a-aec390a254ec on hv-cinder-81571 May 26 13:00:06.205571 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [req-0fe3d63d-58a5-40ae-a7d6-4e6ae024022f req-0d9eeaf0-d90e-4274-9f76-b05032af9e9f service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032338 May 26 13:00:06.206403 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 559/1114] 10.222.0.41 () {64 vars in 1317 bytes} [Thu May 26 13:00:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:00:06.581289 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-b560f554-8b19-4af7-8338-f715ee2617d3 tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:00:06.581842 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-b560f554-8b19-4af7-8338-f715ee2617d3 tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] [instance: 710a7fee-caa1-4364-a32a-aec390a254ec] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:00:06.588541 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-b560f554-8b19-4af7-8338-f715ee2617d3 tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:00:06.588997 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-b560f554-8b19-4af7-8338-f715ee2617d3 tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:00:06.590053 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-b560f554-8b19-4af7-8338-f715ee2617d3 tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:00:06.590491 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-b560f554-8b19-4af7-8338-f715ee2617d3 tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:00:06.623484 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-b560f554-8b19-4af7-8338-f715ee2617d3 tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:00:06.623853 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-b560f554-8b19-4af7-8338-f715ee2617d3 tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:00:06.624310 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.objects.instance [None req-b560f554-8b19-4af7-8338-f715ee2617d3 tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] Lazy-loading 'fault' on Instance uuid 710a7fee-caa1-4364-a32a-aec390a254ec {{(pid=124823) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 13:00:06.665809 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-b560f554-8b19-4af7-8338-f715ee2617d3 tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42918efc43ac4c96b5b5cb8f0c9ae52a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfbb1ec8872f42218abf14ed8ada2e89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:00:06.673191 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-b560f554-8b19-4af7-8338-f715ee2617d3 tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] 10.222.0.41 "GET /compute/v2.1/servers/710a7fee-caa1-4364-a32a-aec390a254ec" status: 200 len: 1304 microversion: 2.1 time: 0.095990 May 26 13:00:06.673781 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 556/1115] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 13:00:06 2022] GET /compute/v2.1/servers/710a7fee-caa1-4364-a32a-aec390a254ec => generated 1304 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:00:07.690848 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-606c40fd-0531-425c-a825-81fd01459728 tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:00:07.691552 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-606c40fd-0531-425c-a825-81fd01459728 tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] [instance: 710a7fee-caa1-4364-a32a-aec390a254ec] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:00:07.699052 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-606c40fd-0531-425c-a825-81fd01459728 tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:00:07.699501 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-606c40fd-0531-425c-a825-81fd01459728 tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:00:07.700272 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-606c40fd-0531-425c-a825-81fd01459728 tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:00:07.700709 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-606c40fd-0531-425c-a825-81fd01459728 tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:00:07.714496 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.wsgi [None req-606c40fd-0531-425c-a825-81fd01459728 tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] HTTP exception thrown: Instance 710a7fee-caa1-4364-a32a-aec390a254ec could not be found. May 26 13:00:07.716432 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-606c40fd-0531-425c-a825-81fd01459728 tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] Request method failure captured: May 26 13:00:07.716432 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: request: GET /compute/v2.1/servers/710a7fee-caa1-4364-a32a-aec390a254ec HTTP/1.1 May 26 13:00:07.716432 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Accept: application/json May 26 13:00:07.716432 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Accept-Encoding: identity May 26 13:00:07.716432 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Connection: close May 26 13:00:07.716432 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Content-Length: 0 May 26 13:00:07.716432 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Content-Type: application/json May 26 13:00:07.716432 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Host: 10.222.0.41 May 26 13:00:07.716432 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Openstack-System-Scope: None May 26 13:00:07.716432 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: User-Agent: python-urllib3/1.26.9 May 26 13:00:07.716432 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Auth-Token: gAAAAABij3nEUoCWFV2N7Hd1i-OH7tLkAptk3JwS9QhkKoKp-6LW51sFhKgcRM7F2eXy47X9boHA1tYJlapE4x5KqJO6BGw_YkMIO6qbswVQLXUlANxk3U4-VW73Og8p3lkgEfAKdgJiv9rolLbs5_2cBbzlc5FkeBKwaBuOaQD1y9Bqzm1iz1s May 26 13:00:07.716432 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Domain-Id: None May 26 13:00:07.716432 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Domain-Name: None May 26 13:00:07.716432 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Identity-Status: Confirmed May 26 13:00:07.716432 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Is-Admin-Project: True May 26 13:00:07.716432 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Domain-Id: default May 26 13:00:07.716432 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Domain-Name: Default May 26 13:00:07.716432 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Id: bfbb1ec8872f42218abf14ed8ada2e89 May 26 13:00:07.716432 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Name: tempest-VolumesNegativeTest-274709018 May 26 13:00:07.716432 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Role: member,reader May 26 13:00:07.716432 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Roles: member,reader May 26 13:00:07.718211 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/bfbb1ec8872f42218abf14ed8ada2e89"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/bfbb1ec8872f42218abf14ed8ada2e89"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/bfbb1ec8872f42218abf14ed8ada2e89"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_bfbb1ec8872f42218abf14ed8ada2e89", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 26 13:00:07.718211 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Tenant: tempest-VolumesNegativeTest-274709018 May 26 13:00:07.718211 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Tenant-Id: bfbb1ec8872f42218abf14ed8ada2e89 May 26 13:00:07.718211 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Tenant-Name: tempest-VolumesNegativeTest-274709018 May 26 13:00:07.718211 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User: tempest-VolumesNegativeTest-274709018-project May 26 13:00:07.718211 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Domain-Id: default May 26 13:00:07.718211 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Domain-Name: Default May 26 13:00:07.718211 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Id: 42918efc43ac4c96b5b5cb8f0c9ae52a May 26 13:00:07.718211 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Name: tempest-VolumesNegativeTest-274709018-project May 26 13:00:07.718211 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: method: > May 26 13:00:07.718211 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: exception: Instance 710a7fee-caa1-4364-a32a-aec390a254ec could not be found. May 26 13:00:07.718211 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: action_args: {'id': '710a7fee-caa1-4364-a32a-aec390a254ec'} May 26 13:00:07.718211 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 13:00:07.719520 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:00:07.719520 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 13:00:07.719520 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 13:00:07.719520 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 13:00:07.719520 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 13:00:07.719520 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 13:00:07.719520 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 13:00:07.719520 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 13:00:07.719520 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 13:00:07.719520 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 710a7fee-caa1-4364-a32a-aec390a254ec could not be found. May 26 13:00:07.719520 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 13:00:07.719520 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:00:07.719520 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 13:00:07.719520 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:00:07.719520 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:00:07.719520 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:00:07.719520 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 13:00:07.719520 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 13:00:07.719520 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 13:00:07.719520 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 13:00:07.721208 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 13:00:07.721208 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 13:00:07.721208 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 13:00:07.721208 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 13:00:07.721208 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 13:00:07.721208 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 13:00:07.721208 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 710a7fee-caa1-4364-a32a-aec390a254ec could not be found. May 26 13:00:07.721208 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 13:00:07.721208 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:00:07.721208 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 13:00:07.721208 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:00:07.721208 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:00:07.721208 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:00:07.721208 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 13:00:07.721208 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 13:00:07.721208 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 710a7fee-caa1-4364-a32a-aec390a254ec could not be found. May 26 13:00:07.721208 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 13:00:07.722720 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-606c40fd-0531-425c-a825-81fd01459728 tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] Returning 404 to user: Instance 710a7fee-caa1-4364-a32a-aec390a254ec could not be found. {{(pid=124824) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 13:00:07.722720 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-606c40fd-0531-425c-a825-81fd01459728 tempest-VolumesNegativeTest-274709018 tempest-VolumesNegativeTest-274709018-project] 10.222.0.41 "GET /compute/v2.1/servers/710a7fee-caa1-4364-a32a-aec390a254ec" status: 404 len: 111 microversion: 2.1 time: 0.031242 May 26 13:00:07.722720 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 560/1116] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 13:00:07 2022] GET /compute/v2.1/servers/710a7fee-caa1-4364-a32a-aec390a254ec => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 13:01:07.435120 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG dbcounter [-] [124823] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=124823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:01:07.436446 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG dbcounter [-] [124823] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:01:07.439699 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [req-27ef5d4e-7c98-47dc-9ab2-b9cae9a3501b req-3fa852aa-2104-41f1-a44e-a881dc16e413 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3e49793-145c-4fea-979c-3875adb1ef35", "tag": "e52542b8-e1ca-485c-bbda-287934dde033"}]} {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:01:07.440737 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-33a03efa-c290-4570-9f4b-81295acceef6 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:01:07.441305 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-33a03efa-c290-4570-9f4b-81295acceef6 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] [instance: d3e49793-145c-4fea-979c-3875adb1ef35] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:01:07.445054 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG dbcounter [-] [124824] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=3 {{(pid=124824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:01:07.445881 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG dbcounter [-] [124824] Writing DB stats nova_cell1:SELECT=70 {{(pid=124824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:01:07.448047 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-33a03efa-c290-4570-9f4b-81295acceef6 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:01:07.448950 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-33a03efa-c290-4570-9f4b-81295acceef6 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:01:07.449905 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-33a03efa-c290-4570-9f4b-81295acceef6 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:01:07.450386 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [req-27ef5d4e-7c98-47dc-9ab2-b9cae9a3501b req-3fa852aa-2104-41f1-a44e-a881dc16e413 service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:01:07.454475 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [req-27ef5d4e-7c98-47dc-9ab2-b9cae9a3501b req-3fa852aa-2104-41f1-a44e-a881dc16e413 service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:01:07.454622 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-33a03efa-c290-4570-9f4b-81295acceef6 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:01:07.463103 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.compute.server_external_events [req-27ef5d4e-7c98-47dc-9ab2-b9cae9a3501b req-3fa852aa-2104-41f1-a44e-a881dc16e413 service nova] Creating event network-changed:e52542b8-e1ca-485c-bbda-287934dde033 for instance d3e49793-145c-4fea-979c-3875adb1ef35 on hv-cinder-81571 May 26 13:01:07.470072 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [req-27ef5d4e-7c98-47dc-9ab2-b9cae9a3501b req-3fa852aa-2104-41f1-a44e-a881dc16e413 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034207 May 26 13:01:07.471644 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 561/1117] 10.222.0.41 () {64 vars in 1317 bytes} [Thu May 26 13:01:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 13:01:07.485457 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-33a03efa-c290-4570-9f4b-81295acceef6 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] [instance: d3e49793-145c-4fea-979c-3875adb1ef35] Going to try to terminate instance {{(pid=124823) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 13:01:07.799765 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-33a03efa-c290-4570-9f4b-81295acceef6 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] 10.222.0.41 "DELETE /compute/v2.1/servers/d3e49793-145c-4fea-979c-3875adb1ef35" status: 204 len: 0 microversion: 2.1 time: 0.366468 May 26 13:01:07.800772 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 557/1118] 10.222.0.41 () {58 vars in 1238 bytes} [Thu May 26 13:01:07 2022] DELETE /compute/v2.1/servers/d3e49793-145c-4fea-979c-3875adb1ef35 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 13:01:07.810375 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-e399aae5-abff-47c4-97a9-b6df097b9ce6 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:01:07.812042 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-e399aae5-abff-47c4-97a9-b6df097b9ce6 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] [instance: d3e49793-145c-4fea-979c-3875adb1ef35] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:01:07.820790 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-e399aae5-abff-47c4-97a9-b6df097b9ce6 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:01:07.821357 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-e399aae5-abff-47c4-97a9-b6df097b9ce6 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:01:07.822227 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-e399aae5-abff-47c4-97a9-b6df097b9ce6 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:01:07.822728 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-e399aae5-abff-47c4-97a9-b6df097b9ce6 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:01:08.133355 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.policy [None req-e399aae5-abff-47c4-97a9-b6df097b9ce6 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03ca4f264eb42ddbe92f5cb95d9fc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2ea80ac0374c2c870a494adc6534ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124824) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:01:08.141681 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-e399aae5-abff-47c4-97a9-b6df097b9ce6 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] 10.222.0.41 "GET /compute/v2.1/servers/d3e49793-145c-4fea-979c-3875adb1ef35" status: 200 len: 1567 microversion: 2.1 time: 0.336659 May 26 13:01:08.142467 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 562/1119] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 13:01:07 2022] GET /compute/v2.1/servers/d3e49793-145c-4fea-979c-3875adb1ef35 => generated 1567 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:01:09.159187 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-b10fcc7d-9aa7-4c1d-868b-4d4cfd492c94 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:01:09.159892 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-b10fcc7d-9aa7-4c1d-868b-4d4cfd492c94 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] [instance: d3e49793-145c-4fea-979c-3875adb1ef35] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:01:09.166819 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-b10fcc7d-9aa7-4c1d-868b-4d4cfd492c94 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:01:09.167268 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-b10fcc7d-9aa7-4c1d-868b-4d4cfd492c94 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:01:09.168045 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-b10fcc7d-9aa7-4c1d-868b-4d4cfd492c94 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:01:09.168470 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-b10fcc7d-9aa7-4c1d-868b-4d4cfd492c94 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:01:09.304170 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-b10fcc7d-9aa7-4c1d-868b-4d4cfd492c94 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03ca4f264eb42ddbe92f5cb95d9fc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2ea80ac0374c2c870a494adc6534ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:01:09.311654 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-b10fcc7d-9aa7-4c1d-868b-4d4cfd492c94 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] 10.222.0.41 "GET /compute/v2.1/servers/d3e49793-145c-4fea-979c-3875adb1ef35" status: 200 len: 1449 microversion: 2.1 time: 0.157165 May 26 13:01:09.312847 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 558/1120] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 13:01:09 2022] GET /compute/v2.1/servers/d3e49793-145c-4fea-979c-3875adb1ef35 => generated 1449 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:01:09.843339 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [req-607c375c-2d44-47f8-a987-0771ecb6f730 req-92267a3a-ff14-4be5-aee9-1721163ce3b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3e49793-145c-4fea-979c-3875adb1ef35", "name": "network-vif-deleted", "tag": "e52542b8-e1ca-485c-bbda-287934dde033"}]} {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:01:09.853477 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [req-607c375c-2d44-47f8-a987-0771ecb6f730 req-92267a3a-ff14-4be5-aee9-1721163ce3b9 service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:01:09.856239 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [req-607c375c-2d44-47f8-a987-0771ecb6f730 req-92267a3a-ff14-4be5-aee9-1721163ce3b9 service nova] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:01:09.867158 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.compute.server_external_events [req-607c375c-2d44-47f8-a987-0771ecb6f730 req-92267a3a-ff14-4be5-aee9-1721163ce3b9 service nova] Creating event network-vif-deleted:e52542b8-e1ca-485c-bbda-287934dde033 for instance d3e49793-145c-4fea-979c-3875adb1ef35 on hv-cinder-81571 May 26 13:01:09.872502 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [req-607c375c-2d44-47f8-a987-0771ecb6f730 req-92267a3a-ff14-4be5-aee9-1721163ce3b9 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032987 May 26 13:01:09.873165 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 563/1121] 10.222.0.41 () {64 vars in 1317 bytes} [Thu May 26 13:01:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:01:10.328429 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-a96e6763-804b-440e-81a6-2d67b03820f0 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Calling method '>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:01:10.329607 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.compute.api [None req-a96e6763-804b-440e-81a6-2d67b03820f0 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] [instance: d3e49793-145c-4fea-979c-3875adb1ef35] Fetching instance by UUID {{(pid=124823) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:01:10.336184 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-a96e6763-804b-440e-81a6-2d67b03820f0 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:01:10.336634 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-a96e6763-804b-440e-81a6-2d67b03820f0 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:01:10.337398 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-a96e6763-804b-440e-81a6-2d67b03820f0 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:01:10.337870 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG oslo_concurrency.lockutils [None req-a96e6763-804b-440e-81a6-2d67b03820f0 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:01:10.399481 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.policy [None req-a96e6763-804b-440e-81a6-2d67b03820f0 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03ca4f264eb42ddbe92f5cb95d9fc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2ea80ac0374c2c870a494adc6534ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124823) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:01:10.407891 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-a96e6763-804b-440e-81a6-2d67b03820f0 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] 10.222.0.41 "GET /compute/v2.1/servers/d3e49793-145c-4fea-979c-3875adb1ef35" status: 200 len: 1219 microversion: 2.1 time: 0.082872 May 26 13:01:10.408464 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 559/1122] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 13:01:10 2022] GET /compute/v2.1/servers/d3e49793-145c-4fea-979c-3875adb1ef35 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:01:11.425195 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-6ff3e8a1-84b1-414f-86c0-4530b7e47e76 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Calling method '>' {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:01:11.426665 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.compute.api [None req-6ff3e8a1-84b1-414f-86c0-4530b7e47e76 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] [instance: d3e49793-145c-4fea-979c-3875adb1ef35] Fetching instance by UUID {{(pid=124824) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:01:11.433167 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-6ff3e8a1-84b1-414f-86c0-4530b7e47e76 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:01:11.433620 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-6ff3e8a1-84b1-414f-86c0-4530b7e47e76 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:01:11.434443 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-6ff3e8a1-84b1-414f-86c0-4530b7e47e76 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:01:11.434919 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG oslo_concurrency.lockutils [None req-6ff3e8a1-84b1-414f-86c0-4530b7e47e76 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Lock "8040d8fc-4b5c-4b3f-be84-000e94e5def8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:01:11.449851 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.wsgi [None req-6ff3e8a1-84b1-414f-86c0-4530b7e47e76 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] HTTP exception thrown: Instance d3e49793-145c-4fea-979c-3875adb1ef35 could not be found. May 26 13:01:11.451516 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-6ff3e8a1-84b1-414f-86c0-4530b7e47e76 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Request method failure captured: May 26 13:01:11.451516 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: request: GET /compute/v2.1/servers/d3e49793-145c-4fea-979c-3875adb1ef35 HTTP/1.1 May 26 13:01:11.451516 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Accept: application/json May 26 13:01:11.451516 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Accept-Encoding: identity May 26 13:01:11.451516 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Connection: close May 26 13:01:11.451516 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Content-Length: 0 May 26 13:01:11.451516 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Content-Type: application/json May 26 13:01:11.451516 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Host: 10.222.0.41 May 26 13:01:11.451516 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Openstack-System-Scope: None May 26 13:01:11.451516 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: User-Agent: python-urllib3/1.26.9 May 26 13:01:11.451516 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Auth-Token: gAAAAABij3j_HfmQYrUlrk60fD-ew2G1kEZ6Qma_ZaWRXOZ0g9EAjkDwNX_pyXt76l5hcAd4oj-U21W0r3hCZvW4gSJocs1DK-KPauKOE6zy-3h6XKdCox8W5eUKMchmU7XgtnaNxB9jxCJYNDhVk580Zrt00fSiU75_m9nFx3kfazzD3e94myk May 26 13:01:11.451516 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Domain-Id: None May 26 13:01:11.451516 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Domain-Name: None May 26 13:01:11.451516 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Identity-Status: Confirmed May 26 13:01:11.451516 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Is-Admin-Project: True May 26 13:01:11.451516 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Domain-Id: default May 26 13:01:11.451516 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Domain-Name: Default May 26 13:01:11.451516 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Id: 0c2ea80ac0374c2c870a494adc6534ff May 26 13:01:11.451516 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Project-Name: tempest-TestShelveInstance-1523752075 May 26 13:01:11.451516 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Role: member,reader May 26 13:01:11.451516 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Roles: member,reader May 26 13:01:11.453930 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/0c2ea80ac0374c2c870a494adc6534ff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/0c2ea80ac0374c2c870a494adc6534ff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/0c2ea80ac0374c2c870a494adc6534ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_0c2ea80ac0374c2c870a494adc6534ff", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 26 13:01:11.453930 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Tenant: tempest-TestShelveInstance-1523752075 May 26 13:01:11.453930 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Tenant-Id: 0c2ea80ac0374c2c870a494adc6534ff May 26 13:01:11.453930 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-Tenant-Name: tempest-TestShelveInstance-1523752075 May 26 13:01:11.453930 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User: tempest-TestShelveInstance-1523752075-project May 26 13:01:11.453930 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Domain-Id: default May 26 13:01:11.453930 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Domain-Name: Default May 26 13:01:11.453930 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Id: e03ca4f264eb42ddbe92f5cb95d9fc2f May 26 13:01:11.453930 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: X-User-Name: tempest-TestShelveInstance-1523752075-project May 26 13:01:11.453930 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: method: > May 26 13:01:11.453930 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: exception: Instance d3e49793-145c-4fea-979c-3875adb1ef35 could not be found. May 26 13:01:11.453930 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: action_args: {'id': 'd3e49793-145c-4fea-979c-3875adb1ef35'} May 26 13:01:11.453930 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: {{(pid=124824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 13:01:11.455069 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:01:11.455069 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 13:01:11.455069 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 13:01:11.455069 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 13:01:11.455069 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 13:01:11.455069 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 13:01:11.455069 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 13:01:11.455069 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 13:01:11.455069 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 13:01:11.455069 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3e49793-145c-4fea-979c-3875adb1ef35 could not be found. May 26 13:01:11.455069 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 13:01:11.455069 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:01:11.455069 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 13:01:11.455069 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:01:11.455069 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:01:11.455069 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:01:11.455069 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 13:01:11.455069 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 13:01:11.455069 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 13:01:11.455069 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 13:01:11.457299 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 13:01:11.457299 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 13:01:11.457299 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 13:01:11.457299 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 13:01:11.457299 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 13:01:11.457299 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 13:01:11.457299 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3e49793-145c-4fea-979c-3875adb1ef35 could not be found. May 26 13:01:11.457299 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 13:01:11.457299 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:01:11.457299 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 13:01:11.457299 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:01:11.457299 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:01:11.457299 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:01:11.457299 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 13:01:11.457299 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 13:01:11.457299 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3e49793-145c-4fea-979c-3875adb1ef35 could not be found. May 26 13:01:11.457299 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: ERROR nova.api.openstack.wsgi May 26 13:01:11.458792 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: DEBUG nova.api.openstack.wsgi [None req-6ff3e8a1-84b1-414f-86c0-4530b7e47e76 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Returning 404 to user: Instance d3e49793-145c-4fea-979c-3875adb1ef35 could not be found. {{(pid=124824) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 13:01:11.458792 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO nova.api.openstack.requestlog [None req-6ff3e8a1-84b1-414f-86c0-4530b7e47e76 tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] 10.222.0.41 "GET /compute/v2.1/servers/d3e49793-145c-4fea-979c-3875adb1ef35" status: 404 len: 111 microversion: 2.1 time: 0.032507 May 26 13:01:11.458792 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: [pid: 124824|app: 0|req: 564/1123] 10.222.0.41 () {58 vars in 1235 bytes} [Thu May 26 13:01:11 2022] GET /compute/v2.1/servers/d3e49793-145c-4fea-979c-3875adb1ef35 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 13:01:11.684771 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: DEBUG nova.api.openstack.wsgi [None req-caead098-3d2f-4ec2-939a-1560686f93cd tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] Calling method '.version_select at 0x7f26a3bad550>' {{(pid=124823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:01:11.777802 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO nova.api.openstack.requestlog [None req-caead098-3d2f-4ec2-939a-1560686f93cd tempest-TestShelveInstance-1523752075 tempest-TestShelveInstance-1523752075-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-967223777" status: 202 len: 0 microversion: 2.1 time: 0.096816 May 26 13:01:11.778389 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: [pid: 124823|app: 0|req: 560/1124] 10.222.0.41 () {58 vars in 1250 bytes} [Thu May 26 13:01:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-967223777 => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 13:01:40.571809 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 13:01:40.572459 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Thu May 26 13:01:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 13:02:47.974197 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 13:02:47.975010 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Thu May 26 13:02:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 13:03:24.957816 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 13:03:24.958426 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Thu May 26 13:03:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 13:05:00.580459 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 13:05:00.581115 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Thu May 26 13:05:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 13:06:07.982328 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 13:06:07.983144 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Thu May 26 13:06:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 13:06:17.253810 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 13:06:17.254300 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Thu May 26 13:06:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 13:06:31.425687 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 13:06:31.426345 dv-cinder-815712-9-iscsi devstack@n-api.service[124823]: Thu May 26 13:06:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 13:06:36.248507 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 13:06:36.249021 dv-cinder-815712-9-iscsi devstack@n-api.service[124824]: Thu May 26 13:06:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!